2024-09-19T05:27:46.424 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:27:46.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:27:46.535 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686 branch: squid description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911686' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - overall HEALTH_ - \(MON_DOWN\) sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHyQBbDgWO5F66AnCBxHw+AXDdS+FROS5YH8HuR/7QeeHFce6/KY6JuERsWect3OLyILr03/1K7WYq34qWZVa0= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjA71TCDlYuoYVMva44ecDJ+oU+IL0rOaxAdVSSsG92fgv+jI1+iTCwfNLo8L6Rjhd2Zg9VByaT7GfCwBhFNiI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:27:46.535 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:27:46.536 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:27:46.536 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:27:46.538 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:27:46.561 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:27:46.561 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:27:46.562 INFO:teuthology.packaging:ref: None 2024-09-19T05:27:46.562 INFO:teuthology.packaging:tag: None 2024-09-19T05:27:46.562 INFO:teuthology.packaging:branch: squid 2024-09-19T05:27:46.562 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:27:46.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T05:27:46.778 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T05:27:46.780 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:27:46.785 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:27:46.786 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:27:46.808 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:27:46.826 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:27:46.833 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:27:46.854 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:22:28.576419', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHyQBbDgWO5F66AnCBxHw+AXDdS+FROS5YH8HuR/7QeeHFce6/KY6JuERsWect3OLyILr03/1K7WYq34qWZVa0='} 2024-09-19T05:27:46.875 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:22:28.578256', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjA71TCDlYuoYVMva44ecDJ+oU+IL0rOaxAdVSSsG92fgv+jI1+iTCwfNLo8L6Rjhd2Zg9VByaT7GfCwBhFNiI='} 2024-09-19T05:27:46.876 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:27:46.882 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-19T05:27:46.882 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-19T05:27:46.882 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:27:46.941 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f54c2f4fbe0>, signals=[15]) 2024-09-19T05:27:46.941 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:27:46.947 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:27:46.947 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:27:46.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:27:47.028 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:27:47.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:27:47.104 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:27:47.111 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-19T05:27:47.130 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-19T05:27:47.130 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-19T05:27:47.188 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-19T05:27:47.188 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:27:47.189 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:27:47.190 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-19T05:27:47.213 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-09-19T05:27:47.231 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-09-19T05:27:47.232 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-09-19T05:27:47.289 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-09-19T05:27:47.289 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-09-19T05:27:47.289 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-09-19T05:27:47.289 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:27:47.289 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-09-19T05:27:47.289 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:27:47.289 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:27:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-09-19T05:27:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:27:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:27:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:27:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:27:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:27:47.290 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:27:47.290 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-09-19T05:27:47.313 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:27:47.322 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:27:47.330 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:27:47.330 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:27:47.332 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:27:47.349 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:27:47.355 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:27:47.355 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:27:47.390 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:27:47.719 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:27:47.775 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:27:47.789 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:27:47.789 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T05:27:47.789 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:27:47.790 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:27:47.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:27:47.807 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-19T05:27:47.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:27:47.808 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-09-19T05:27:47.865 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:27:47.866 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-503.el9.x86_64 2024-09-19T05:27:47.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-09-19T05:27:47.867 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:27:47.867 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.14.0-503.el9.x86_64 2024-09-19T05:27:47.867 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2024-09-19T05:27:50.041 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-19T05:27:50.628 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.3 MB 00:01 2024-09-19T05:27:51.736 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-19T05:27:54.255 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 20 MB 00:02 2024-09-19T05:27:56.076 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-19T05:27:57.601 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-19T05:27:58.697 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-19T05:27:59.564 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-19T05:28:01.357 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-19T05:28:02.294 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T05:28:04.077 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T05:28:05.909 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:28:05.909 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:28:06.014 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-09-19T05:28:06.023 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-09-19T05:28:06.024 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-09-19T05:28:06.024 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-09-19T05:28:06.024 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-09-19T05:28:06.024 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:28:06.024 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-09-19T05:28:06.025 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:28:06.025 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:28:06.025 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:28:06.025 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:28:06.025 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-09-19T05:28:06.025 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-09-19T05:28:06.026 INFO:teuthology.orchestra.run.smithi174.stdout:Install 4 Packages 2024-09-19T05:28:06.026 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:28:06.026 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 79 M 2024-09-19T05:28:06.026 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 126 M 2024-09-19T05:28:06.026 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-09-19T05:28:06.154 INFO:teuthology.orchestra.run.smithi174.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 331 kB/s | 36 kB 00:00 2024-09-19T05:28:06.538 INFO:teuthology.orchestra.run.smithi174.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-19T05:28:06.996 INFO:teuthology.orchestra.run.smithi174.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-19T05:28:07.246 INFO:teuthology.orchestra.run.smithi174.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-19T05:28:07.247 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:28:07.247 INFO:teuthology.orchestra.run.smithi174.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-19T05:28:07.708 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T05:28:07.932 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-09-19T05:28:08.273 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-09-19T05:28:08.273 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-09-19T05:28:09.249 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-09-19T05:28:09.249 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-09-19T05:28:09.623 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:28:09.623 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:28:09.704 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:28:09.716 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:28:09.717 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-19T05:28:09.717 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-19T05:28:09.717 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-19T05:28:09.717 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:28:09.717 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 79 M 2024-09-19T05:28:09.717 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-09-19T05:28:09.717 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-19T05:28:09.893 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 298 kB/s | 36 kB 00:00 2024-09-19T05:28:11.671 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-09-19T05:28:11.797 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 7.7 MB/s | 16 MB 00:02 2024-09-19T05:28:12.306 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:28:12.390 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:28:13.320 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 8.3 MB/s | 29 MB 00:03 2024-09-19T05:28:14.088 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 8.0 MB/s | 35 MB 00:04 2024-09-19T05:28:14.088 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:28:14.088 INFO:teuthology.orchestra.run.smithi103.stdout:Total 18 MB/s | 79 MB 00:04 2024-09-19T05:28:14.771 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-19T05:28:15.136 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-19T05:28:15.136 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-19T05:28:15.142 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:28:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-19T05:28:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-19T05:28:18.559 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-19T05:28:19.198 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:28:19.279 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:28:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:28:20.207 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:28:22.072 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:28:22.206 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:28:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:28:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:28:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:28:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:03.565 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:03.605 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:03.977 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:03.977 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:29:03.977 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:29:03.977 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:29:04.840 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:04.840 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:29:04.840 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-09-19T05:29:04.840 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:29:04.841 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:29:04.841 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:29:04.841 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:29:04.841 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:29:04.841 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-09-19T05:29:05.162 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:29:05.287 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:29:05.287 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:29:05.287 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:29:05.287 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:29:05.287 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:29:05.288 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T05:29:05.288 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:29:05.288 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:29:05.347 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:29:05.347 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:29:05.347 DEBUG:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2-tools 2024-09-19T05:29:05.383 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2-tools 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.06 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 82.el9 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Group : Unspecified 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 8274670 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:29:05.384 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : builder@centos.org 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Support tools for GRUB. 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:29:05.385 INFO:teuthology.orchestra.run.smithi174.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:29:05.386 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:29:05.386 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:29:05.386 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:29:06.059 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-09-19T05:29:07.378 INFO:teuthology.orchestra.run.smithi174.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:29:07.406 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-09-19T05:29:07.408 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-09-19T05:29:07.423 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.ZiBnM4Q5oT 2024-09-19T05:29:07.424 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZiBnM4Q5oT 2024-09-19T05:29:07.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.ZiBnM4Q5oT 2024-09-19T05:29:07.630 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.ZiBnM4Q5oT is 6KB 2024-09-19T05:29:07.678 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.ZiBnM4Q5oT 2024-09-19T05:29:07.693 DEBUG:teuthology.orchestra.run.smithi174:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:29:07.758 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:29:07.758 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:29:07.758 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:29:07.759 INFO:teuthology.orchestra.run.smithi174.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:29:07.760 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:29:07.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-09-19T05:29:10.364 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:10.405 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:29:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:29:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:29:11.639 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:29:11.639 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:29:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-19T05:29:11.640 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:29:11.640 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:29:11.640 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:29:11.640 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:29:11.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:29:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-19T05:29:12.013 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:29:12.100 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:29:12.101 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:29:12.101 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:29:12.101 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:29:12.101 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:29:12.101 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T05:29:12.101 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:29:12.102 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:29:12.160 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:29:12.160 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:29:12.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-19T05:29:12.198 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-19T05:29:12.198 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:29:12.199 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:29:12.200 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:29:12.201 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:29:12.201 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:29:12.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:29:12.848 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-19T05:29:14.197 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:29:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-19T05:29:14.234 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-19T05:29:14.250 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.lM1iPVoEe0 2024-09-19T05:29:14.250 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lM1iPVoEe0 2024-09-19T05:29:14.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.lM1iPVoEe0 2024-09-19T05:29:14.453 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.lM1iPVoEe0 is 6KB 2024-09-19T05:29:14.501 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.lM1iPVoEe0 2024-09-19T05:29:14.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:29:14.586 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:29:14.586 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:29:14.586 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:29:14.586 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:29:14.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:29:14.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-19T05:29:37.937 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T05:29:37.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:29:37.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:29:44.753 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T05:29:44.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:29:44.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:29:56.285 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-09-19T05:30:03.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-19T05:30:05.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:30:05.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:30:08.353 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-09-19T05:30:12.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:30:12.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:30:15.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-19T05:30:20.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:30:20.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:30:27.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:30:27.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:30:30.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-19T05:30:38.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-09-19T05:30:45.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:30:45.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:30:53.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:30:53.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:30:54.155 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-09-19T05:30:54.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:30:54.564 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:30:54.565 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-09-19T05:30:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:30:54.579 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:30:54.579 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:30:54.579 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:30:55.580 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T05:30:55.580 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:30:55.643 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2024-09-19T05:30:55.664 DEBUG:teuthology.parallel:result is None 2024-09-19T05:31:17.500 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-19T05:31:17.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:31:17.849 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:31:17.850 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-19T05:31:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:31:17.866 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:31:17.866 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:31:17.866 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:31:18.867 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T05:31:18.867 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:31:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-19T05:31:18.964 DEBUG:teuthology.parallel:result is None 2024-09-19T05:31:18.964 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:31:18.971 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:31:18.971 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:31:18.974 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:31:18.993 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:31:19.040 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:31:19.184 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:31:19.184 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:31:19.187 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:31:19.223 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:31:19.340 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:31:19.340 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:31:19.343 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:31:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:31:19.383 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:31:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:31:19.394 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:31:19.395 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:31:19.405 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:31:19.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:31:19.435 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:31:19.463 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:31:19.472 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:31:19.473 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:31:19.503 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:31:19.520 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:31:19.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:31:19.647 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:31:19.729 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:31:19.771 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:31:19.771 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:31:19.837 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:31:19.882 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:31:19.940 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:31:20.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:31:20.066 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:31:20.066 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:31:20.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-19T05:31:20.135 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-09-19T05:31:20.186 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:31:20.216 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:31:20.645 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:31:20.653 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:31:20.653 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:31:20.759 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:31:20.827 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-19T05:31:20.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-19T05:31:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-19T05:31:20.880 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-09-19T05:31:20.920 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-09-19T05:31:20.922 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:31:20.922 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-19T05:31:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-19T05:31:20.954 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-09-19T05:31:20.989 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-09-19T05:31:20.990 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-09-19T05:31:20.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:31:21.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:31:21.022 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:31:21.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:31:21.057 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:31:21.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:31:21.096 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:31:21.131 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:31:21.139 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T05:31:21.143 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T05:31:21.292 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:31:21.303 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:31:21.304 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T05:35:05.630 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-09-19T05:35:05.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:35:05.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:35:05.716 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-19T05:35:05.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-19T05:35:05.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:35:05.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:35:05.867 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-09-19T05:35:05.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-19T05:35:05.945 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T05:35:05.956 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T05:35:05.956 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:35:05.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:35:05.959 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:35:05.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:35:05.988 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:35:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:35:06.014 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:35:06.027 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-19T05:35:06.028 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:35:06.038 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-19T05:35:06.053 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-09-19T05:35:06.053 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:35:06.064 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-09-19T05:35:06.067 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:35:06.078 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:35:06.092 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:35:06.124 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:35:06.127 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:35:06.127 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-19T05:35:06.127 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.127 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.127 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.127 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.147 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:35:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:35:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-19T05:35:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.152 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.152 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.152 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:35:06.152 INFO:teuthology.run_tasks:Running task install... 2024-09-19T05:35:06.161 DEBUG:teuthology.task.install:project ceph 2024-09-19T05:35:06.161 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T05:35:06.161 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T05:35:06.161 INFO:teuthology.task.install:Using flavor: default 2024-09-19T05:35:06.167 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T05:35:06.167 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T05:35:06.168 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:35:06.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:35:06.170 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:35:06.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:35:06.315 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:35:06.315 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:35:06.319 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:35:06.319 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:35:06.425 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:35:06.426 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:35:06.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:35:06.432 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:35:06.432 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:35:06.432 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:35:06.452 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:35:06.452 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:35:06.458 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:35:06.458 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:35:06.518 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:35:06.524 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:35:06.593 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:35:06.599 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:35:06.657 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-19T05:35:06.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-19T05:35:06.663 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-09-19T05:35:06.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-09-19T05:35:06.891 INFO:teuthology.orchestra.run.smithi174.stdout:45 files removed 2024-09-19T05:35:06.894 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-19T05:35:06.920 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:35:06.926 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:35:07.481 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-19T05:35:07.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-19T05:35:07.765 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:35:07.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:35:08.032 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-19T05:35:08.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T05:35:09.260 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.3 MB 00:01 2024-09-19T05:35:11.490 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.3 MB 00:03 2024-09-19T05:35:11.736 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-19T05:35:13.383 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-19T05:35:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.5 MB 00:01 2024-09-19T05:35:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-19T05:35:18.534 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-19T05:35:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-19T05:35:19.943 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 119 kB/s | 19 kB 00:00 2024-09-19T05:35:20.897 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T05:35:24.774 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T05:35:26.461 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T05:35:26.969 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:35:26.970 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:35:26.983 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:35:26.984 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:35:26.985 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:35:26.986 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:35:26.988 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:35:26.991 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:35:26.992 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:35:27.054 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-19T05:35:27.070 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:35:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:35:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:35:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:35:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:35:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:35:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:35:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:35:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:35:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:35:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:35:27.081 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:35:27.082 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-19T05:35:27.083 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:35:27.084 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:35:27.084 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-19T05:35:27.084 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-19T05:35:27.084 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-09-19T05:35:27.084 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 8 Packages 2024-09-19T05:35:27.084 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:35:27.084 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 226 M 2024-09-19T05:35:27.085 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-19T05:35:27.734 INFO:teuthology.orchestra.run.smithi103.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T05:35:27.934 INFO:teuthology.orchestra.run.smithi103.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.4 MB/s | 896 kB 00:00 2024-09-19T05:35:28.018 INFO:teuthology.orchestra.run.smithi103.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.7 MB/s | 145 kB 00:00 2024-09-19T05:35:28.093 INFO:teuthology.orchestra.run.smithi103.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T05:35:28.218 INFO:teuthology.orchestra.run.smithi103.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-19T05:35:28.277 INFO:teuthology.orchestra.run.smithi103.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.2 MB/s | 2.4 MB 00:00 2024-09-19T05:35:28.519 INFO:teuthology.orchestra.run.smithi103.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-19T05:35:28.629 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:35:28.630 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:35:28.641 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:35:28.642 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:35:28.642 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:35:28.643 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:35:28.645 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:35:28.647 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:35:28.648 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:35:28.710 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-09-19T05:35:28.724 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================== 2024-09-19T05:35:28.724 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-09-19T05:35:28.724 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================== 2024-09-19T05:35:28.724 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-09-19T05:35:28.724 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:35:28.724 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:35:28.724 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:35:28.725 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:35:28.726 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-09-19T05:35:28.727 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:35:28.728 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:35:28.729 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:35:28.730 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:35:28.731 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:35:28.732 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:35:28.733 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:35:28.734 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:35:28.735 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:35:28.736 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================== 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout:Install 148 Packages 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2024-09-19T05:35:28.737 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:35:28.738 INFO:teuthology.orchestra.run.smithi103.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T05:35:28.738 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 226 M 2024-09-19T05:35:28.738 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-09-19T05:35:28.769 INFO:teuthology.orchestra.run.smithi103.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 606 kB/s | 25 kB 00:00 2024-09-19T05:35:29.161 INFO:teuthology.orchestra.run.smithi103.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T05:35:29.228 INFO:teuthology.orchestra.run.smithi103.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.3 MB/s | 228 kB 00:00 2024-09-19T05:35:29.295 INFO:teuthology.orchestra.run.smithi103.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 406 kB/s | 27 kB 00:00 2024-09-19T05:35:29.454 INFO:teuthology.orchestra.run.smithi174.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 42 kB/s | 6.6 kB 00:00 2024-09-19T05:35:29.495 INFO:teuthology.orchestra.run.smithi103.stdout:(13/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T05:35:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 141 kB/s | 32 kB 00:00 2024-09-19T05:35:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T05:35:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T05:35:29.664 INFO:teuthology.orchestra.run.smithi103.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.1 MB/s | 127 kB 00:00 2024-09-19T05:35:29.755 INFO:teuthology.orchestra.run.smithi103.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 2.7 MB/s | 506 kB 00:00 2024-09-19T05:35:29.839 INFO:teuthology.orchestra.run.smithi103.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 541 kB/s | 45 kB 00:00 2024-09-19T05:35:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.1 MB/s | 896 kB 00:00 2024-09-19T05:35:29.914 INFO:teuthology.orchestra.run.smithi103.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T05:35:29.937 INFO:teuthology.orchestra.run.smithi174.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 8.4 MB/s | 5.4 MB 00:00 2024-09-19T05:35:29.963 INFO:teuthology.orchestra.run.smithi174.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T05:35:29.981 INFO:teuthology.orchestra.run.smithi103.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.4 MB/s | 161 kB 00:00 2024-09-19T05:35:30.065 INFO:teuthology.orchestra.run.smithi103.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.8 MB/s | 320 kB 00:00 2024-09-19T05:35:30.149 INFO:teuthology.orchestra.run.smithi103.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.5 MB/s | 300 kB 00:00 2024-09-19T05:35:30.224 INFO:teuthology.orchestra.run.smithi103.stdout:(24/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 9.6 MB/s | 5.3 MB 00:00 2024-09-19T05:35:30.249 INFO:teuthology.orchestra.run.smithi103.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 990 kB/s | 99 kB 00:00 2024-09-19T05:35:30.279 INFO:teuthology.orchestra.run.smithi174.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.8 MB/s | 1.5 MB 00:00 2024-09-19T05:35:30.283 INFO:teuthology.orchestra.run.smithi103.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T05:35:30.375 INFO:teuthology.orchestra.run.smithi103.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-19T05:35:30.467 INFO:teuthology.orchestra.run.smithi103.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 346 kB/s | 32 kB 00:00 2024-09-19T05:35:30.559 INFO:teuthology.orchestra.run.smithi103.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-19T05:35:30.584 INFO:teuthology.orchestra.run.smithi103.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.2 MB/s | 146 kB 00:00 2024-09-19T05:35:30.772 INFO:teuthology.orchestra.run.smithi174.stdout:(6/156): ceph-common-19.1.1-361.g2f599a46.el9.x 14 MB/s | 21 MB 00:01 2024-09-19T05:35:30.821 INFO:teuthology.orchestra.run.smithi174.stdout:(7/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.7 MB/s | 2.4 MB 00:00 2024-09-19T05:35:30.835 INFO:teuthology.orchestra.run.smithi103.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 13 MB/s | 3.6 MB 00:00 2024-09-19T05:35:30.910 INFO:teuthology.orchestra.run.smithi103.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.3 MB/s | 249 kB 00:00 2024-09-19T05:35:30.985 INFO:teuthology.orchestra.run.smithi103.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 660 kB/s | 49 kB 00:00 2024-09-19T05:35:31.005 INFO:teuthology.orchestra.run.smithi174.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 6.5 MB/s | 4.7 MB 00:00 2024-09-19T05:35:31.044 INFO:teuthology.orchestra.run.smithi103.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 281 kB/s | 16 kB 00:00 2024-09-19T05:35:31.064 INFO:teuthology.orchestra.run.smithi174.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 432 kB/s | 25 kB 00:00 2024-09-19T05:35:31.119 INFO:teuthology.orchestra.run.smithi103.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T05:35:31.228 INFO:teuthology.orchestra.run.smithi103.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-19T05:35:31.328 INFO:teuthology.orchestra.run.smithi103.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 10 MB/s | 7.4 MB 00:00 2024-09-19T05:35:31.345 INFO:teuthology.orchestra.run.smithi103.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 156 kB/s | 18 kB 00:00 2024-09-19T05:35:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 16 MB/s | 49 MB 00:03 2024-09-19T05:35:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 147 kB/s | 80 kB 00:00 2024-09-19T05:35:31.872 INFO:teuthology.orchestra.run.smithi174.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 15 MB/s | 17 MB 00:01 2024-09-19T05:35:31.929 INFO:teuthology.orchestra.run.smithi103.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-19T05:35:31.931 INFO:teuthology.orchestra.run.smithi174.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T05:35:31.963 INFO:teuthology.orchestra.run.smithi103.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-19T05:35:31.988 INFO:teuthology.orchestra.run.smithi103.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-19T05:35:31.990 INFO:teuthology.orchestra.run.smithi174.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 464 kB/s | 27 kB 00:00 2024-09-19T05:35:32.013 INFO:teuthology.orchestra.run.smithi103.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T05:35:32.030 INFO:teuthology.orchestra.run.smithi103.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T05:35:32.056 INFO:teuthology.orchestra.run.smithi103.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-19T05:35:32.081 INFO:teuthology.orchestra.run.smithi103.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:35:32.098 INFO:teuthology.orchestra.run.smithi174.stdout:(13/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 8.3 MB/s | 11 MB 00:01 2024-09-19T05:35:32.115 INFO:teuthology.orchestra.run.smithi174.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 253 kB/s | 32 kB 00:00 2024-09-19T05:35:32.140 INFO:teuthology.orchestra.run.smithi103.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-19T05:35:32.165 INFO:teuthology.orchestra.run.smithi174.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T05:35:32.191 INFO:teuthology.orchestra.run.smithi174.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T05:35:32.233 INFO:teuthology.orchestra.run.smithi174.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.8 MB/s | 127 kB 00:00 2024-09-19T05:35:32.240 INFO:teuthology.orchestra.run.smithi103.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-19T05:35:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 854 kB/s | 107 kB 00:00 2024-09-19T05:35:32.292 INFO:teuthology.orchestra.run.smithi174.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T05:35:32.292 INFO:teuthology.orchestra.run.smithi103.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-19T05:35:32.333 INFO:teuthology.orchestra.run.smithi103.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 790 kB/s | 33 kB 00:00 2024-09-19T05:35:32.358 INFO:teuthology.orchestra.run.smithi103.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T05:35:32.368 INFO:teuthology.orchestra.run.smithi174.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 602 kB/s | 45 kB 00:00 2024-09-19T05:35:32.392 INFO:teuthology.orchestra.run.smithi103.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-19T05:35:32.417 INFO:teuthology.orchestra.run.smithi103.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-19T05:35:32.442 INFO:teuthology.orchestra.run.smithi103.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T05:35:32.451 INFO:teuthology.orchestra.run.smithi174.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T05:35:32.485 INFO:teuthology.orchestra.run.smithi103.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T05:35:32.509 INFO:teuthology.orchestra.run.smithi103.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-19T05:35:32.529 INFO:teuthology.orchestra.run.smithi174.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T05:35:32.618 INFO:teuthology.orchestra.run.smithi174.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T05:35:32.626 INFO:teuthology.orchestra.run.smithi103.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-19T05:35:32.669 INFO:teuthology.orchestra.run.smithi103.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-19T05:35:32.694 INFO:teuthology.orchestra.run.smithi103.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-19T05:35:32.719 INFO:teuthology.orchestra.run.smithi103.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-19T05:35:32.726 INFO:teuthology.orchestra.run.smithi174.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T05:35:32.751 INFO:teuthology.orchestra.run.smithi174.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.2 MB/s | 300 kB 00:00 2024-09-19T05:35:32.777 INFO:teuthology.orchestra.run.smithi174.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T05:35:32.786 INFO:teuthology.orchestra.run.smithi103.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-19T05:35:32.802 INFO:teuthology.orchestra.run.smithi174.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T05:35:32.811 INFO:teuthology.orchestra.run.smithi103.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T05:35:32.837 INFO:teuthology.orchestra.run.smithi103.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-19T05:35:33.095 INFO:teuthology.orchestra.run.smithi103.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-09-19T05:35:33.211 INFO:teuthology.orchestra.run.smithi174.stdout:(27/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 23 MB/s | 49 MB 00:02 2024-09-19T05:35:33.235 INFO:teuthology.orchestra.run.smithi174.stdout:(28/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 394 kB/s | 171 kB 00:00 2024-09-19T05:35:33.261 INFO:teuthology.orchestra.run.smithi174.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 639 kB/s | 32 kB 00:00 2024-09-19T05:35:33.286 INFO:teuthology.orchestra.run.smithi174.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T05:35:33.353 INFO:teuthology.orchestra.run.smithi174.stdout:(31/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 5.4 MB/s | 3.1 MB 00:00 2024-09-19T05:35:33.437 INFO:teuthology.orchestra.run.smithi174.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 20 MB/s | 3.6 MB 00:00 2024-09-19T05:35:33.462 INFO:teuthology.orchestra.run.smithi174.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.3 MB/s | 249 kB 00:00 2024-09-19T05:35:33.479 INFO:teuthology.orchestra.run.smithi174.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T05:35:33.496 INFO:teuthology.orchestra.run.smithi174.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 494 kB/s | 16 kB 00:00 2024-09-19T05:35:33.529 INFO:teuthology.orchestra.run.smithi103.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-19T05:35:33.529 INFO:teuthology.orchestra.run.smithi174.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T05:35:33.580 INFO:teuthology.orchestra.run.smithi174.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-19T05:35:33.605 INFO:teuthology.orchestra.run.smithi174.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 243 kB/s | 18 kB 00:00 2024-09-19T05:35:33.737 INFO:teuthology.orchestra.run.smithi103.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-09-19T05:35:33.763 INFO:teuthology.orchestra.run.smithi174.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 505 kB/s | 80 kB 00:00 2024-09-19T05:35:33.779 INFO:teuthology.orchestra.run.smithi103.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-19T05:35:33.838 INFO:teuthology.orchestra.run.smithi103.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 2.9 MB/s | 910 kB 00:00 2024-09-19T05:35:33.864 INFO:teuthology.orchestra.run.smithi174.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-19T05:35:33.889 INFO:teuthology.orchestra.run.smithi174.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-19T05:35:33.923 INFO:teuthology.orchestra.run.smithi174.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-19T05:35:33.981 INFO:teuthology.orchestra.run.smithi174.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T05:35:34.031 INFO:teuthology.orchestra.run.smithi174.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-09-19T05:35:34.057 INFO:teuthology.orchestra.run.smithi174.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-19T05:35:34.082 INFO:teuthology.orchestra.run.smithi174.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:35:34.107 INFO:teuthology.orchestra.run.smithi174.stdout:(47/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-19T05:35:34.122 INFO:teuthology.orchestra.run.smithi103.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-19T05:35:34.132 INFO:teuthology.orchestra.run.smithi174.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T05:35:34.188 INFO:teuthology.orchestra.run.smithi103.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-19T05:35:34.214 INFO:teuthology.orchestra.run.smithi103.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 954 kB/s | 87 kB 00:00 2024-09-19T05:35:34.249 INFO:teuthology.orchestra.run.smithi174.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 107 kB 00:00 2024-09-19T05:35:34.256 INFO:teuthology.orchestra.run.smithi103.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T05:35:34.275 INFO:teuthology.orchestra.run.smithi174.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-09-19T05:35:34.308 INFO:teuthology.orchestra.run.smithi174.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-19T05:35:34.333 INFO:teuthology.orchestra.run.smithi174.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-19T05:35:34.348 INFO:teuthology.orchestra.run.smithi103.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-19T05:35:34.359 INFO:teuthology.orchestra.run.smithi174.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-19T05:35:34.376 INFO:teuthology.orchestra.run.smithi174.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-19T05:35:34.418 INFO:teuthology.orchestra.run.smithi174.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-19T05:35:34.435 INFO:teuthology.orchestra.run.smithi174.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-19T05:35:34.440 INFO:teuthology.orchestra.run.smithi103.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-19T05:35:34.482 INFO:teuthology.orchestra.run.smithi103.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-19T05:35:34.485 INFO:teuthology.orchestra.run.smithi174.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-19T05:35:34.502 INFO:teuthology.orchestra.run.smithi174.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-09-19T05:35:34.524 INFO:teuthology.orchestra.run.smithi103.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-19T05:35:34.552 INFO:teuthology.orchestra.run.smithi174.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-19T05:35:34.585 INFO:teuthology.orchestra.run.smithi174.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-19T05:35:34.599 INFO:teuthology.orchestra.run.smithi103.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T05:35:34.611 INFO:teuthology.orchestra.run.smithi174.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-19T05:35:34.628 INFO:teuthology.orchestra.run.smithi174.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T05:35:34.641 INFO:teuthology.orchestra.run.smithi103.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 835 kB/s | 35 kB 00:00 2024-09-19T05:35:34.645 INFO:teuthology.orchestra.run.smithi174.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-19T05:35:34.678 INFO:teuthology.orchestra.run.smithi174.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-19T05:35:34.703 INFO:teuthology.orchestra.run.smithi174.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T05:35:34.720 INFO:teuthology.orchestra.run.smithi174.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-19T05:35:34.804 INFO:teuthology.orchestra.run.smithi174.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T05:35:34.858 INFO:teuthology.orchestra.run.smithi103.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.4 MB/s | 5.8 MB 00:01 2024-09-19T05:35:34.871 INFO:teuthology.orchestra.run.smithi174.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-19T05:35:34.917 INFO:teuthology.orchestra.run.smithi103.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-19T05:35:34.937 INFO:teuthology.orchestra.run.smithi174.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-19T05:35:34.963 INFO:teuthology.orchestra.run.smithi174.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T05:35:34.979 INFO:teuthology.orchestra.run.smithi103.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T05:35:34.996 INFO:teuthology.orchestra.run.smithi174.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-19T05:35:35.017 INFO:teuthology.orchestra.run.smithi103.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-19T05:35:35.047 INFO:teuthology.orchestra.run.smithi174.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T05:35:35.051 INFO:teuthology.orchestra.run.smithi103.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-19T05:35:35.072 INFO:teuthology.orchestra.run.smithi174.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-19T05:35:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-19T05:35:35.139 INFO:teuthology.orchestra.run.smithi174.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 29 MB/s | 5.8 MB 00:00 2024-09-19T05:35:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-19T05:35:35.173 INFO:teuthology.orchestra.run.smithi174.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 609 kB/s | 61 kB 00:00 2024-09-19T05:35:35.223 INFO:teuthology.orchestra.run.smithi174.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T05:35:35.244 INFO:teuthology.orchestra.run.smithi103.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-19T05:35:35.248 INFO:teuthology.orchestra.run.smithi174.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-19T05:35:35.278 INFO:teuthology.orchestra.run.smithi103.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-09-19T05:35:35.311 INFO:teuthology.orchestra.run.smithi103.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T05:35:35.315 INFO:teuthology.orchestra.run.smithi174.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-19T05:35:35.340 INFO:teuthology.orchestra.run.smithi174.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-19T05:35:35.366 INFO:teuthology.orchestra.run.smithi174.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-19T05:35:35.391 INFO:teuthology.orchestra.run.smithi174.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T05:35:35.433 INFO:teuthology.orchestra.run.smithi174.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 522 kB/s | 35 kB 00:00 2024-09-19T05:35:35.458 INFO:teuthology.orchestra.run.smithi174.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-19T05:35:35.541 INFO:teuthology.orchestra.run.smithi174.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-09-19T05:35:35.558 INFO:teuthology.orchestra.run.smithi174.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-09-19T05:35:35.584 INFO:teuthology.orchestra.run.smithi174.stdout:(86/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-19T05:35:35.609 INFO:teuthology.orchestra.run.smithi174.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 632 kB/s | 42 kB 00:00 2024-09-19T05:35:35.634 INFO:teuthology.orchestra.run.smithi174.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-19T05:35:35.659 INFO:teuthology.orchestra.run.smithi174.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T05:35:35.693 INFO:teuthology.orchestra.run.smithi174.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-19T05:35:35.727 INFO:teuthology.orchestra.run.smithi174.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-19T05:35:35.752 INFO:teuthology.orchestra.run.smithi174.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 582 kB/s | 54 kB 00:00 2024-09-19T05:35:35.785 INFO:teuthology.orchestra.run.smithi174.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-19T05:35:35.819 INFO:teuthology.orchestra.run.smithi174.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-09-19T05:35:35.861 INFO:teuthology.orchestra.run.smithi174.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-19T05:35:35.894 INFO:teuthology.orchestra.run.smithi174.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-09-19T05:35:36.011 INFO:teuthology.orchestra.run.smithi103.stdout:(91/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-09-19T05:35:36.045 INFO:teuthology.orchestra.run.smithi103.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-19T05:35:36.053 INFO:teuthology.orchestra.run.smithi174.stdout:(97/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-19T05:35:36.070 INFO:teuthology.orchestra.run.smithi174.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 227 kB/s | 47 kB 00:00 2024-09-19T05:35:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T05:35:36.095 INFO:teuthology.orchestra.run.smithi174.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-19T05:35:36.120 INFO:teuthology.orchestra.run.smithi174.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-19T05:35:36.145 INFO:teuthology.orchestra.run.smithi174.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-19T05:35:36.162 INFO:teuthology.orchestra.run.smithi174.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 64 kB 00:00 2024-09-19T05:35:36.187 INFO:teuthology.orchestra.run.smithi174.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-19T05:35:36.195 INFO:teuthology.orchestra.run.smithi103.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-09-19T05:35:36.221 INFO:teuthology.orchestra.run.smithi103.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-19T05:35:36.246 INFO:teuthology.orchestra.run.smithi103.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-19T05:35:36.246 INFO:teuthology.orchestra.run.smithi174.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T05:35:36.263 INFO:teuthology.orchestra.run.smithi174.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-19T05:35:36.271 INFO:teuthology.orchestra.run.smithi103.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-09-19T05:35:36.289 INFO:teuthology.orchestra.run.smithi174.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T05:35:36.313 INFO:teuthology.orchestra.run.smithi103.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T05:35:36.322 INFO:teuthology.orchestra.run.smithi174.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-19T05:35:36.347 INFO:teuthology.orchestra.run.smithi174.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:35:36.372 INFO:teuthology.orchestra.run.smithi103.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-19T05:35:36.389 INFO:teuthology.orchestra.run.smithi174.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-19T05:35:36.397 INFO:teuthology.orchestra.run.smithi103.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-19T05:35:36.408 INFO:teuthology.orchestra.run.smithi174.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 826 kB/s | 49 kB 00:00 2024-09-19T05:35:36.439 INFO:teuthology.orchestra.run.smithi103.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 950 kB/s | 64 kB 00:00 2024-09-19T05:35:36.448 INFO:teuthology.orchestra.run.smithi174.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T05:35:36.464 INFO:teuthology.orchestra.run.smithi103.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-09-19T05:35:36.473 INFO:teuthology.orchestra.run.smithi174.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-09-19T05:35:36.532 INFO:teuthology.orchestra.run.smithi103.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-19T05:35:36.540 INFO:teuthology.orchestra.run.smithi174.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T05:35:36.557 INFO:teuthology.orchestra.run.smithi174.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T05:35:36.574 INFO:teuthology.orchestra.run.smithi174.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T05:35:36.598 INFO:teuthology.orchestra.run.smithi103.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-19T05:35:36.608 INFO:teuthology.orchestra.run.smithi174.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-19T05:35:36.625 INFO:teuthology.orchestra.run.smithi174.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T05:35:36.632 INFO:teuthology.orchestra.run.smithi103.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-09-19T05:35:36.666 INFO:teuthology.orchestra.run.smithi103.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.5 MB/s | 308 kB 00:00 2024-09-19T05:35:36.666 INFO:teuthology.orchestra.run.smithi174.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-19T05:35:36.691 INFO:teuthology.orchestra.run.smithi103.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 330 kB/s | 19 kB 00:00 2024-09-19T05:35:36.692 INFO:teuthology.orchestra.run.smithi174.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-19T05:35:36.717 INFO:teuthology.orchestra.run.smithi103.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:35:36.717 INFO:teuthology.orchestra.run.smithi174.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-19T05:35:36.742 INFO:teuthology.orchestra.run.smithi174.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-19T05:35:36.750 INFO:teuthology.orchestra.run.smithi103.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T05:35:36.776 INFO:teuthology.orchestra.run.smithi174.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T05:35:36.784 INFO:teuthology.orchestra.run.smithi103.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T05:35:36.801 INFO:teuthology.orchestra.run.smithi174.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-19T05:35:36.826 INFO:teuthology.orchestra.run.smithi103.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-19T05:35:36.826 INFO:teuthology.orchestra.run.smithi174.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T05:35:36.852 INFO:teuthology.orchestra.run.smithi174.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-09-19T05:35:36.877 INFO:teuthology.orchestra.run.smithi174.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T05:35:36.902 INFO:teuthology.orchestra.run.smithi174.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T05:35:36.927 INFO:teuthology.orchestra.run.smithi174.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-19T05:35:36.935 INFO:teuthology.orchestra.run.smithi103.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-09-19T05:35:36.961 INFO:teuthology.orchestra.run.smithi174.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T05:35:36.995 INFO:teuthology.orchestra.run.smithi174.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T05:35:37.045 INFO:teuthology.orchestra.run.smithi174.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.2 MB/s | 2.0 MB 00:00 2024-09-19T05:35:37.070 INFO:teuthology.orchestra.run.smithi174.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-09-19T05:35:37.095 INFO:teuthology.orchestra.run.smithi174.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-19T05:35:37.118 INFO:teuthology.orchestra.run.smithi103.stdout:(113/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-09-19T05:35:37.121 INFO:teuthology.orchestra.run.smithi174.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T05:35:37.152 INFO:teuthology.orchestra.run.smithi103.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-09-19T05:35:37.154 INFO:teuthology.orchestra.run.smithi174.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-09-19T05:35:37.180 INFO:teuthology.orchestra.run.smithi174.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-19T05:35:37.205 INFO:teuthology.orchestra.run.smithi174.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 338 kB/s | 28 kB 00:00 2024-09-19T05:35:37.210 INFO:teuthology.orchestra.run.smithi103.stdout:(115/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-09-19T05:35:37.230 INFO:teuthology.orchestra.run.smithi174.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-19T05:35:37.236 INFO:teuthology.orchestra.run.smithi103.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 394 kB/s | 32 kB 00:00 2024-09-19T05:35:37.256 INFO:teuthology.orchestra.run.smithi174.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T05:35:37.261 INFO:teuthology.orchestra.run.smithi103.stdout:(117/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 305 kB/s | 43 kB 00:00 2024-09-19T05:35:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T05:35:37.287 INFO:teuthology.orchestra.run.smithi103.stdout:(118/156): python3-certifi-2023.05.07-4.el9.noa 187 kB/s | 14 kB 00:00 2024-09-19T05:35:37.306 INFO:teuthology.orchestra.run.smithi174.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T05:35:37.312 INFO:teuthology.orchestra.run.smithi103.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-19T05:35:37.337 INFO:teuthology.orchestra.run.smithi103.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T05:35:37.362 INFO:teuthology.orchestra.run.smithi103.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-19T05:35:37.388 INFO:teuthology.orchestra.run.smithi103.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-19T05:35:37.413 INFO:teuthology.orchestra.run.smithi103.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T05:35:37.414 INFO:teuthology.orchestra.run.smithi174.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 469 kB/s | 74 kB 00:00 2024-09-19T05:35:37.438 INFO:teuthology.orchestra.run.smithi103.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-19T05:35:37.463 INFO:teuthology.orchestra.run.smithi103.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.3 MB/s | 23 kB 00:00 2024-09-19T05:35:37.478 INFO:teuthology.orchestra.run.smithi174.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-09-19T05:35:37.489 INFO:teuthology.orchestra.run.smithi103.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 834 kB/s | 19 kB 00:00 2024-09-19T05:35:37.507 INFO:teuthology.orchestra.run.smithi174.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 980 kB/s | 90 kB 00:00 2024-09-19T05:35:37.514 INFO:teuthology.orchestra.run.smithi103.stdout:(127/156): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2024-09-19T05:35:37.524 INFO:teuthology.orchestra.run.smithi174.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 439 kB/s | 20 kB 00:00 2024-09-19T05:35:37.531 INFO:teuthology.orchestra.run.smithi103.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-09-19T05:35:37.548 INFO:teuthology.orchestra.run.smithi103.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T05:35:37.567 INFO:teuthology.orchestra.run.smithi174.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T05:35:37.573 INFO:teuthology.orchestra.run.smithi103.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:35:37.582 INFO:teuthology.orchestra.run.smithi174.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-19T05:35:37.590 INFO:teuthology.orchestra.run.smithi103.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T05:35:37.641 INFO:teuthology.orchestra.run.smithi174.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-19T05:35:37.649 INFO:teuthology.orchestra.run.smithi103.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.5 MB/s | 2.0 MB 00:00 2024-09-19T05:35:37.666 INFO:teuthology.orchestra.run.smithi103.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 985 kB/s | 16 kB 00:00 2024-09-19T05:35:37.691 INFO:teuthology.orchestra.run.smithi103.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T05:35:37.717 INFO:teuthology.orchestra.run.smithi103.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T05:35:37.742 INFO:teuthology.orchestra.run.smithi103.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-19T05:35:37.776 INFO:teuthology.orchestra.run.smithi103.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-19T05:35:37.801 INFO:teuthology.orchestra.run.smithi103.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 366 kB/s | 31 kB 00:00 2024-09-19T05:35:37.826 INFO:teuthology.orchestra.run.smithi103.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T05:35:37.833 INFO:teuthology.orchestra.run.smithi174.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T05:35:37.851 INFO:teuthology.orchestra.run.smithi103.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T05:35:37.877 INFO:teuthology.orchestra.run.smithi103.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T05:35:37.902 INFO:teuthology.orchestra.run.smithi103.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T05:35:37.957 INFO:teuthology.orchestra.run.smithi103.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-09-19T05:35:37.986 INFO:teuthology.orchestra.run.smithi103.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 685 kB/s | 20 kB 00:00 2024-09-19T05:35:37.992 INFO:teuthology.orchestra.run.smithi174.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-19T05:35:38.011 INFO:teuthology.orchestra.run.smithi103.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-09-19T05:35:38.037 INFO:teuthology.orchestra.run.smithi103.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T05:35:38.042 INFO:teuthology.orchestra.run.smithi174.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-09-19T05:35:38.062 INFO:teuthology.orchestra.run.smithi103.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-19T05:35:38.109 INFO:teuthology.orchestra.run.smithi174.stdout:(152/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.6 MB/s | 1.8 MB 00:00 2024-09-19T05:35:38.121 INFO:teuthology.orchestra.run.smithi103.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:35:38.134 INFO:teuthology.orchestra.run.smithi174.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-19T05:35:38.151 INFO:teuthology.orchestra.run.smithi174.stdout:(154/156): NetworkManager-team-1.51.0-1.el9.x86 257 kB/s | 41 kB 00:00 2024-09-19T05:35:38.251 INFO:teuthology.orchestra.run.smithi174.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-19T05:35:38.279 INFO:teuthology.orchestra.run.smithi103.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-19T05:35:38.326 INFO:teuthology.orchestra.run.smithi174.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-19T05:35:38.333 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:35:38.333 INFO:teuthology.orchestra.run.smithi174.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-19T05:35:38.363 INFO:teuthology.orchestra.run.smithi103.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 9.9 MB/s | 2.3 MB 00:00 2024-09-19T05:35:38.405 INFO:teuthology.orchestra.run.smithi103.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 986 kB/s | 41 kB 00:00 2024-09-19T05:35:38.447 INFO:teuthology.orchestra.run.smithi103.stdout:(152/156): NetworkManager-libnm-1.51.0-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-09-19T05:35:38.472 INFO:teuthology.orchestra.run.smithi103.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.6 MB/s | 249 kB 00:00 2024-09-19T05:35:38.514 INFO:teuthology.orchestra.run.smithi103.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-19T05:35:38.564 INFO:teuthology.orchestra.run.smithi103.stdout:(155/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.3 MB/s | 3.2 MB 00:00 2024-09-19T05:35:38.614 INFO:teuthology.orchestra.run.smithi103.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-19T05:35:38.620 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:35:38.620 INFO:teuthology.orchestra.run.smithi103.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-19T05:35:39.568 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-09-19T05:35:39.719 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-09-19T05:35:39.719 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-09-19T05:35:39.798 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-19T05:35:39.948 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-19T05:35:39.948 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-19T05:35:41.883 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-09-19T05:35:41.884 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-09-19T05:35:42.190 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-19T05:35:42.190 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-19T05:35:48.283 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-09-19T05:35:48.413 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:35:48.518 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:35:48.656 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-19T05:35:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:35:48.722 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:35:48.748 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:35:48.786 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:35:48.810 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:35:48.832 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:35:48.898 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:35:48.936 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:35:48.970 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:35:49.024 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:35:49.187 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:35:49.238 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:35:49.344 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:35:49.351 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:35:49.381 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:35:49.471 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:35:49.477 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:35:49.511 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:35:49.593 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:35:49.622 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:35:49.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:35:49.714 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:35:49.735 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:35:49.750 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:35:49.760 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:35:49.846 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:35:49.869 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:35:49.915 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:35:49.934 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:35:49.945 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:35:49.964 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:35:50.029 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:35:50.060 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:35:50.154 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:35:50.165 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:35:50.209 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:35:50.280 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:35:50.314 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:35:50.325 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:35:50.333 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:35:50.443 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:35:50.530 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:35:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:35:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:35:50.707 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:35:50.833 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:35:50.863 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:35:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:35:50.991 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:35:51.052 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:35:51.086 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:35:51.123 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:35:51.167 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:35:51.231 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:35:51.276 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:35:51.325 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:35:51.325 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:35:51.368 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:35:51.401 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:35:51.429 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:35:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:35:51.497 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:35:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:35:51.551 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:35:51.583 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:35:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:35:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:35:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:35:51.699 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:35:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:35:51.744 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:35:51.752 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:35:51.779 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:35:51.784 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:35:51.807 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:35:51.828 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:35:51.861 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:35:51.877 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:35:51.888 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:35:51.931 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:35:51.958 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:35:52.004 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:35:52.010 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:35:52.043 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:35:52.085 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:35:52.136 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:35:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:35:52.183 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:35:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:35:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:35:52.284 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:35:52.353 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:35:52.399 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:35:52.473 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:35:52.606 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:35:52.668 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:35:52.701 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:35:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:35:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:35:52.842 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:35:52.871 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:35:52.916 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:35:53.085 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:35:53.141 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:35:53.195 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:35:53.199 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:35:53.268 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:35:53.280 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:35:53.300 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:35:53.310 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:35:53.336 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:35:53.354 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:35:53.382 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:35:53.399 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:35:53.427 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:35:53.468 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:35:53.469 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:35:53.512 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:35:53.636 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:35:53.647 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:35:53.689 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:35:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:35:53.758 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:35:53.830 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:35:53.831 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:35:53.863 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:35:53.899 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:35:53.932 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:35:53.945 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:35:53.965 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:35:53.990 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:35:54.015 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:35:54.033 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:35:54.046 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:35:54.070 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:35:54.084 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:35:54.164 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:35:54.221 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:35:54.287 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:35:54.319 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:35:54.351 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:35:54.381 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:35:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:35:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:35:54.477 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:35:54.481 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:35:54.507 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:35:54.519 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:35:54.535 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:35:54.577 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:35:54.612 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:35:54.624 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:35:54.662 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:35:54.698 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:35:54.703 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:35:54.752 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:35:54.769 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:35:54.776 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:35:54.806 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:35:54.885 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:35:54.909 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:35:54.957 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:35:55.012 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:35:55.051 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:35:55.080 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:35:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:35:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:35:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:35:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:35:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:35:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:35:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:35:55.375 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:35:55.461 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:35:55.505 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:35:55.545 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:35:55.657 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:35:55.664 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:35:55.712 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:35:55.713 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:35:55.746 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:35:55.855 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:35:55.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:35:55.953 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:35:56.033 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:35:56.073 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:35:56.256 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:35:56.288 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:35:56.365 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:35:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:35:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:35:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:35:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:35:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:35:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:35:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:35:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:35:57.009 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:35:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:35:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:35:57.133 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:35:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:35:57.799 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:35:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:35:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:35:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:35:58.501 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:35:58.535 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:35:58.882 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:35:59.064 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:35:59.148 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:35:59.177 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:35:59.188 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:35:59.217 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:35:59.270 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:35:59.308 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:35:59.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:35:59.649 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:35:59.694 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:35:59.694 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:35:59.725 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:35:59.784 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:35:59.797 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:35:59.816 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:35:59.826 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:35:59.969 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:36:00.459 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:36:00.498 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:36:00.569 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:36:00.600 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:36:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:36:02.414 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:36:02.956 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:36:02.993 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:36:03.067 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:36:03.068 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:36:03.068 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:36:03.068 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:03.119 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:36:03.311 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:36:03.346 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:36:03.891 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:36:03.950 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:36:04.043 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:36:04.043 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:36:04.043 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:36:04.043 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:36:14.866 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-09-19T05:36:14.867 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:15.037 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:36:15.054 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:36:15.054 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:15.054 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:36:15.054 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-19T05:36:16.085 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:16.260 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:36:16.276 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:36:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:36:16.277 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:16.531 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:36:16.557 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:36:16.558 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:16.558 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:36:16.558 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:36:16.558 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:36:16.558 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:16.781 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:36:16.805 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:36:16.805 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:16.806 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:36:16.806 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:36:16.806 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:36:16.806 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:17.232 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:36:17.256 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:36:17.256 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:17.256 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:36:17.256 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:36:17.256 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:36:17.256 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:17.354 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:36:17.410 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:36:17.465 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:36:17.650 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:36:17.699 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:36:17.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:36:17.776 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:36:17.782 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:36:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:36:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:36:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:36:17.783 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:17.864 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:36:18.005 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:36:18.006 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:36:18.029 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:36:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:36:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:36:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:36:18.030 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:18.057 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:36:18.089 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:36:18.117 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:36:18.465 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:36:18.489 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:36:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:36:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:36:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:36:18.489 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:18.551 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:36:18.574 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:36:18.598 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:36:18.605 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:36:18.644 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:36:18.668 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:36:18.697 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:36:18.700 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:36:18.887 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:36:18.942 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:36:19.020 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:36:19.109 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:36:19.250 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:36:19.309 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:36:19.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:36:19.369 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:36:19.738 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:36:19.772 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:36:19.773 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:36:19.801 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:36:19.832 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:36:19.894 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:36:19.924 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:36:20.732 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:36:20.757 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:36:20.858 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:36:20.977 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:36:21.009 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:36:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:36:21.051 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:36:21.075 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:36:21.075 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:21.075 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:36:21.075 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:36:21.075 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:36:21.076 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:21.126 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:36:21.139 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:36:21.228 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:36:21.284 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:36:21.974 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:36:22.001 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:36:22.105 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:36:22.203 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:36:22.237 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:36:22.261 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:36:22.262 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:22.262 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:36:22.262 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:36:22.262 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:36:22.262 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:22.283 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:36:22.304 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:36:22.320 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:36:22.327 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:36:22.327 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:22.328 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:36:22.328 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:22.344 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:36:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:36:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:36:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:36:22.345 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:22.380 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:36:22.396 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:36:22.403 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:36:22.403 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:22.403 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:36:22.403 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:36:22.403 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:36:22.404 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:22.407 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:36:22.506 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:36:22.570 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:36:22.705 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:36:22.729 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:36:22.729 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:22.729 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:36:22.729 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:36:22.729 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:36:22.729 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:23.497 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:36:23.532 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:36:23.557 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:36:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:36:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:36:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:36:23.557 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:23.599 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:36:23.622 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:36:23.622 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:23.622 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:36:23.622 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:36:23.690 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:36:23.690 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:23.690 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:36:23.690 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:36:23.691 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:36:23.691 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:24.001 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:36:24.024 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:36:24.024 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:36:24.024 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:36:24.024 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:36:24.025 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:36:24.025 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:27.276 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:36:27.325 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:36:27.365 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:36:27.398 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:36:27.433 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:36:27.633 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:36:27.680 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:36:27.710 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:36:27.740 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:36:27.786 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:36:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:36:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:36:28.470 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:36:28.589 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:36:28.630 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:36:28.673 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:36:28.703 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:36:28.730 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:36:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:36:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:36:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:36:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:36:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:36:29.298 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:36:29.422 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:36:29.474 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:36:29.571 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:36:29.606 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:36:29.632 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:36:29.674 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:36:29.674 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:36:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:36:29.732 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:36:29.753 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:36:29.758 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:36:29.758 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:36:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:36:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:36:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:36:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:36:30.062 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:36:30.062 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:36:30.145 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:36:30.210 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:36:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:36:30.672 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:36:30.719 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:36:30.825 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:36:30.858 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:36:30.884 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:36:30.910 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:36:30.910 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:36:30.994 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:36:30.994 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:36:31.078 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:36:31.103 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:36:31.108 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:36:31.109 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:36:31.305 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:36:31.305 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:36:31.389 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:36:31.454 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:36:35.879 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:36:35.879 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:36:35.879 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:36:35.880 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:36:35.880 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:36:35.880 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:36:35.880 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:36:35.880 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:36:35.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:36:35.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:36:35.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:36:35.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:36:35.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:36:35.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:36:35.882 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:36:35.882 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:36:35.882 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:36:35.882 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:36:35.882 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:36:35.883 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:36:35.883 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:36:35.883 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:36:35.883 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:36:35.883 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:36:35.884 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:36:35.884 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:36:35.884 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:36:35.884 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:36:35.884 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:36:35.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:36:35.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:36:35.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:36:35.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:36:35.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:36:35.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:36:35.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:36:35.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:36:35.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:36:35.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:36:35.887 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:36:35.887 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:36:35.887 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:36:35.887 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:36:35.887 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:36:35.888 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:36:35.888 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:36:35.888 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:36:35.888 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:36:35.888 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:36:35.889 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:36:35.890 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:36:35.891 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:36:35.892 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:36:35.893 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:36:35.894 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:36:35.895 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:36:35.896 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:36:35.897 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:36:35.898 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:36:35.899 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:36:35.900 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:36:35.901 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:36:35.902 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:36:35.902 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:36:35.902 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:36:35.902 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:36:35.902 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:36:35.903 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:36:35.904 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:36:35.905 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:36:35.906 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:36:35.906 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:36:35.906 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:36:35.906 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:36:35.906 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:36:35.906 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:36:35.906 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:36:37.313 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:36:37.314 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:36:37.315 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:36:37.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:36:37.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:36:37.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:36:37.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:36:37.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:36:37.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:36:37.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:36:37.328 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:36:37.329 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:36:37.330 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:36:37.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:36:37.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:36:37.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:36:37.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:36:37.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:36:37.336 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:36:37.336 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:36:38.553 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:36:38.553 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:38.553 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-09-19T05:36:38.553 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:36:38.554 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.555 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:36:38.556 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:36:38.557 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:36:38.558 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:36:38.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:36:38.560 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:36:38.561 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:36:38.562 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:36:38.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:36:38.564 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:36:38.565 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:36:38.565 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:36:38.565 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:36:38.565 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:36:38.565 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:38.565 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-09-19T05:36:38.991 DEBUG:teuthology.parallel:result is None 2024-09-19T05:36:39.987 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:36:39.987 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:39.987 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-19T05:36:39.987 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:39.987 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:39.987 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:39.987 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.988 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:36:39.990 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:36:39.991 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:36:39.992 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:36:39.993 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:36:39.994 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:36:39.995 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:36:39.996 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:36:39.997 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:36:39.998 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:36:39.999 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:36:39.999 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:36:39.999 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:36:39.999 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:36:39.999 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:39.999 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-19T05:36:40.445 DEBUG:teuthology.parallel:result is None 2024-09-19T05:36:40.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:36:40.588 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:36:40.611 INFO:teuthology.orchestra.run.smithi103.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:36:40.612 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:36:40.612 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:36:40.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:36:40.754 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:36:40.780 INFO:teuthology.orchestra.run.smithi174.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:36:40.780 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:36:40.780 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:36:40.782 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T05:36:40.782 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:40.782 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:36:40.811 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:40.811 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:36:40.852 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T05:36:40.852 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:40.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:36:40.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:36:40.943 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:40.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:36:40.972 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:36:41.039 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T05:36:41.039 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:41.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:36:41.064 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:36:41.129 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:41.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:36:41.157 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:36:41.222 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T05:36:41.223 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:41.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:36:41.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:36:41.311 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:41.312 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:36:41.337 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:36:41.403 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T05:36:41.498 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T05:36:41.498 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-09-19T05:36:41.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-09-19T05:36:41.525 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T05:36:41.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T05:36:41.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T05:36:41.591 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T05:36:41.591 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T05:36:41.631 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T05:36:41.662 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-19T05:36:41.662 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-19T05:36:41.662 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-19T05:36:41.662 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:41.662 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T05:36:41.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:41.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:41.842 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:41.843 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T05:36:41.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:41.972 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T05:36:42.001 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T05:36:42.002 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T05:36:42.002 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686', 'branch': 'squid', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7911686', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1747, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'sleep_before_teardown': 0, 'subset': '176/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHyQBbDgWO5F66AnCBxHw+AXDdS+FROS5YH8HuR/7QeeHFce6/KY6JuERsWect3OLyILr03/1K7WYq34qWZVa0=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjA71TCDlYuoYVMva44ecDJ+oU+IL0rOaxAdVSSsG92fgv+jI1+iTCwfNLo8L6Rjhd2Zg9VByaT7GfCwBhFNiI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T05:36:42.003 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T05:36:42.005 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T05:36:42.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T05:36:42.061 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T05:36:42.116 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:42.116 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:36:42.138 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:36:42.138 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-19T05:36:42.193 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:36:42.193 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:42.193 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T05:36:42.194 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:42.194 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:42.194 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:36:31.873140354 +0000 2024-09-19T05:36:42.194 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:34:45.399210749 +0000 2024-09-19T05:36:42.194 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:34:45.399210749 +0000 2024-09-19T05:36:42.194 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:34:45.399210749 +0000 2024-09-19T05:36:42.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:36:42.256 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:36:42.256 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:36:42.256 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000182597 s, 2.8 MB/s 2024-09-19T05:36:42.257 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:36:42.313 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-19T05:36:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:36:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:42.368 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T05:36:42.369 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:42.369 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:42.369 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:36:31.873140354 +0000 2024-09-19T05:36:42.369 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:34:45.726204612 +0000 2024-09-19T05:36:42.369 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:34:45.726204612 +0000 2024-09-19T05:36:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:34:45.726204612 +0000 2024-09-19T05:36:42.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:36:42.431 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:36:42.431 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:36:42.431 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00016148 s, 3.2 MB/s 2024-09-19T05:36:42.432 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:36:42.488 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-19T05:36:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:36:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:42.544 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T05:36:42.544 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:42.544 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:42.544 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:36:31.873140354 +0000 2024-09-19T05:36:42.544 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:34:46.050198532 +0000 2024-09-19T05:36:42.544 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:34:46.050198532 +0000 2024-09-19T05:36:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:34:46.050198532 +0000 2024-09-19T05:36:42.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:36:42.606 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:36:42.606 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:36:42.606 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000161735 s, 3.2 MB/s 2024-09-19T05:36:42.607 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:36:42.663 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-19T05:36:42.718 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:36:42.718 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:42.718 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T05:36:42.718 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:42.718 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:42.719 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-19 05:36:31.874140335 +0000 2024-09-19T05:36:42.719 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:34:46.382192301 +0000 2024-09-19T05:36:42.719 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:34:46.382192301 +0000 2024-09-19T05:36:42.719 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-19 05:34:46.382192301 +0000 2024-09-19T05:36:42.719 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:36:42.781 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-19T05:36:42.781 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-19T05:36:42.781 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000201688 s, 2.5 MB/s 2024-09-19T05:36:42.784 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:36:42.840 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:36:42.840 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:42.840 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:36:42.860 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:36:42.860 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-09-19T05:36:42.917 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:36:42.917 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:42.918 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T05:36:42.918 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:42.918 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:42.918 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:36:30.557390574 +0000 2024-09-19T05:36:42.918 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:34:45.671319708 +0000 2024-09-19T05:36:42.918 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:34:45.671319708 +0000 2024-09-19T05:36:42.918 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:34:45.671319708 +0000 2024-09-19T05:36:42.918 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:36:42.984 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:36:42.984 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:36:42.984 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00027592 s, 1.9 MB/s 2024-09-19T05:36:42.986 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:36:43.044 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-09-19T05:36:43.102 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:36:43.102 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:43.103 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T05:36:43.103 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:43.103 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:43.103 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:36:30.557390574 +0000 2024-09-19T05:36:43.103 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:34:45.991315526 +0000 2024-09-19T05:36:43.103 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:34:45.991315526 +0000 2024-09-19T05:36:43.103 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:34:45.991315526 +0000 2024-09-19T05:36:43.103 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:36:43.170 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:36:43.170 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:36:43.170 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000226569 s, 2.3 MB/s 2024-09-19T05:36:43.171 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:36:43.229 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-09-19T05:36:43.289 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:36:43.289 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:43.289 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T05:36:43.289 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:43.289 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:43.289 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:36:30.558390561 +0000 2024-09-19T05:36:43.289 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:34:46.309311370 +0000 2024-09-19T05:36:43.290 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:34:46.309311370 +0000 2024-09-19T05:36:43.290 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:34:46.309311370 +0000 2024-09-19T05:36:43.290 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:36:43.354 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:36:43.355 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:36:43.355 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000197578 s, 2.6 MB/s 2024-09-19T05:36:43.356 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:36:43.413 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-09-19T05:36:43.469 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-19 05:36:30.558390561 +0000 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-19 05:34:46.631307162 +0000 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-19 05:34:46.631307162 +0000 2024-09-19T05:36:43.470 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-19 05:34:46.631307162 +0000 2024-09-19T05:36:43.471 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:36:43.534 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-19T05:36:43.534 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-19T05:36:43.534 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000188449 s, 2.7 MB/s 2024-09-19T05:36:43.535 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:36:43.592 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:36:43.592 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T05:36:43.592 INFO:tasks.ceph:Generating config... 2024-09-19T05:36:43.594 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-19T05:36:43.594 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-19T05:36:43.595 INFO:tasks.ceph:[client] debug client = 20 2024-09-19T05:36:43.595 INFO:tasks.ceph:[client] debug ms = 1 2024-09-19T05:36:43.595 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-19T05:36:43.595 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-19T05:36:43.595 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-19T05:36:43.596 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T05:36:43.597 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T05:36:43.598 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T05:36:43.598 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T05:36:43.598 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-19T05:36:43.598 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-19T05:36:43.598 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-19T05:36:43.598 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T05:36:43.599 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-19T05:36:43.599 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T05:36:43.600 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T05:36:43.651 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T05:36:43.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T05:36:43.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T05:36:43.727 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103'), ('mon.b', '172.21.15.174'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]')] 2024-09-19T05:36:43.728 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.103,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-19T05:36:43.730 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:43.730 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T05:36:43.783 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.103 --add b 172.21.15.174 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:43.872 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:43.872 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid a5534b78-3424-4071-a9f5-ce5e90eb5cb1 2024-09-19T05:36:43.872 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-09-19T05:36:43.872 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2024-09-19T05:36:43.872 INFO:teuthology.orchestra.run.smithi103.stdout:fsid a5534b78-3424-4071-a9f5-ce5e90eb5cb1 2024-09-19T05:36:43.872 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2024-09-19T05:36:43.871228+0000 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-19T05:36:43.871228+0000 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 17 (quincy) 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi103.stdout:election_strategy: 1 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi103.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi103.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2024-09-19T05:36:43.873 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T05:36:43.874 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T05:36:43.889 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a5534b78-3424-4071-a9f5-ce5e90eb5cb1... 2024-09-19T05:36:43.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:36:43.931 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T05:36:43.973 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-19T05:36:43.973 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-09-19T05:36:43.973 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:36:43.973 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-09-19T05:36:43.973 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.974 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-09-19T05:36:43.975 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-09-19T05:36:43.976 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.103,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = a5534b78-3424-4071-a9f5-ce5e90eb5cb1 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-09-19T05:36:43.977 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.978 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore compression mode = aggressive 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 20 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 20 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 10 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: mon client directed command retry = 5 2024-09-19T05:36:43.979 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay max = 1 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay probability = 0.005 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay type = client mds 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject socket failures = 2500 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: osd blocked scrub grace period = 3600 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: osd max markdown count = 1000 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-09-19T05:36:43.980 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-19T05:36:43.981 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.982 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: mon down mkfs grace = 300 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: mon op complaint time = 120 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on pool no app = False 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 600 2024-09-19T05:36:43.983 INFO:teuthology.orchestra.run.smithi103.stdout: client_shutdown_timeout = 120 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.e] 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-19T05:36:43.984 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.f] 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout:[mds] 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds = 20 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds balancer = 20 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal fragment size max = 10000 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal merge size = 5 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal split bits = 3 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal split size = 100 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug frag = True 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug scatterstat = True 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds oft prefetch dirfrags = True 2024-09-19T05:36:43.985 INFO:teuthology.orchestra.run.smithi103.stdout: mds op complaint time = 180 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: mds verify scatter = True 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: mds_dir_prefetch = True 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: mds_sleep_rank_change = 5000000.0 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: mon client directed command retry = 5 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay max = 1 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay probability = 0.005 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay type = client mds osd 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject socket failures = 2500 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-09-19T05:36:43.986 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.987 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-09-19T05:36:43.989 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.103,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = a5534b78-3424-4071-a9f5-ce5e90eb5cb1 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-09-19T05:36:43.990 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug trim objects = true 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore compression mode = aggressive 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2024-09-19T05:36:43.992 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 20 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 20 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 10 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: mon client directed command retry = 5 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject delay max = 1 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject delay probability = 0.005 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject delay type = client mds 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject socket failures = 2500 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: osd blocked scrub grace period = 3600 2024-09-19T05:36:43.993 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: osd max markdown count = 1000 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-09-19T05:36:43.994 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.995 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: mon down mkfs grace = 300 2024-09-19T05:36:43.996 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on pool no app = False 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: client_shutdown_timeout = 120 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-09-19T05:36:43.997 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.e] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.f] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-09-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal fragment size max = 10000 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal merge size = 5 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split bits = 3 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split size = 100 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds oft prefetch dirfrags = True 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds_dir_prefetch = True 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mds_sleep_rank_change = 5000000.0 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: mon client directed command retry = 5 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject delay max = 1 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject delay probability = 0.005 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject delay type = client mds osd 2024-09-19T05:36:43.999 INFO:teuthology.orchestra.run.smithi174.stdout: ms inject socket failures = 2500 2024-09-19T05:36:44.000 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-09-19T05:36:44.000 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-09-19T05:36:44.000 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-09-19T05:36:44.001 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T05:36:44.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T05:36:44.096 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T05:36:44.097 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:44.097 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T05:36:44.112 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:44.112 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T05:36:44.167 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:36:44.168 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:44.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T05:36:44.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T05:36:44.241 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:36:44.242 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:44.297 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:36:44.298 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:44.298 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T05:36:44.298 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T05:36:44.335 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:36:44.335 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:44.392 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T05:36:44.392 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T05:36:44.393 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T05:36:44.443 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T05:36:44.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T05:36:44.509 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T05:36:44.512 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T05:36:44.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T05:36:44.564 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T05:36:44.566 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-19T05:36:44.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T05:36:44.682 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T05:36:44.684 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-19T05:36:44.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-19T05:36:44.800 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-19T05:36:44.802 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-19T05:36:44.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T05:36:44.881 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T05:36:44.883 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-19T05:36:44.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T05:36:44.999 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T05:36:45.002 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-19T05:36:45.026 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-19T05:36:45.117 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-19T05:36:45.120 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-19T05:36:45.144 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T05:36:45.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T05:36:45.185 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T05:36:45.198 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T05:36:45.198 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T05:36:45.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T05:36:45.263 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:36:45.263 INFO:tasks.ceph:role: osd.0 2024-09-19T05:36:45.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:36:45.263 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T05:36:45.335 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:36:45.335 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:36:45.335 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:36:45.335 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:36:45.335 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:36:45.336 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:36:45.336 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:36:45.336 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:36:45.336 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:36:45.336 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:36:45.850 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-19T05:36:45.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-19T05:36:45.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T05:36:45.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T05:36:46.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T05:36:46.078 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:36:46.078 INFO:tasks.ceph:role: osd.1 2024-09-19T05:36:46.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:36:46.079 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T05:36:46.150 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:36:46.150 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:36:46.151 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:36:46.617 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-19T05:36:46.619 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-19T05:36:46.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T05:36:46.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T05:36:46.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T05:36:46.805 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:36:46.805 INFO:tasks.ceph:role: osd.2 2024-09-19T05:36:46.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:36:46.805 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T05:36:46.877 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:36:46.877 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:36:46.878 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:36:47.355 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-19T05:36:47.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-19T05:36:47.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T05:36:47.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T05:36:47.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T05:36:47.604 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T05:36:47.604 INFO:tasks.ceph:role: osd.3 2024-09-19T05:36:47.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:36:47.605 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T05:36:47.676 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:36:47.677 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:36:48.185 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-19T05:36:48.187 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-19T05:36:48.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T05:36:48.337 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T05:36:48.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:48.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:48.464+0000 7f6fe8e0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T05:36:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:48.464+0000 7f6fe8e0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T05:36:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:48.464+0000 7f6fe8e0f640 -1 bdev(0x558ff019f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T05:36:48.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:48.464+0000 7f6fe8e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T05:36:51.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T05:36:51.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:51.989+0000 7fe5fc20c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T05:36:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:51.989+0000 7fe5fc20c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T05:36:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:51.989+0000 7fe5fc20c640 -1 bdev(0x562f38d47800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T05:36:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:51.989+0000 7fe5fc20c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T05:36:55.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T05:36:55.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:55.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:55.259+0000 7f3565dfd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:55.259+0000 7f3565dfd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:55.259+0000 7f3565dfd640 -1 bdev(0x5636de17f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T05:36:55.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:55.259+0000 7f3565dfd640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T05:36:58.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T05:36:58.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:58.526+0000 7fdd7c433640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:58.526+0000 7fdd7c433640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:58.527+0000 7fdd7c433640 -1 bdev(0x562a44d55800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T05:36:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:36:58.527+0000 7fdd7c433640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T05:37:01.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T05:37:01.465 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T05:37:01.495 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:37:01.495 INFO:tasks.ceph:role: osd.4 2024-09-19T05:37:01.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:37:01.495 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:37:01.571 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:37:01.572 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:37:01.572 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:37:02.088 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-09-19T05:37:02.091 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-09-19T05:37:02.091 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T05:37:02.242 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T05:37:02.279 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T05:37:02.347 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:37:02.347 INFO:tasks.ceph:role: osd.5 2024-09-19T05:37:02.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:37:02.347 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T05:37:02.421 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:37:02.421 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:37:02.421 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:37:02.421 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:37:02.421 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:37:02.421 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:37:02.421 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:37:02.422 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:37:02.422 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:37:02.422 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:37:02.878 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-09-19T05:37:02.880 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-09-19T05:37:02.881 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T05:37:02.968 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T05:37:02.997 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T05:37:03.063 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:37:03.063 INFO:tasks.ceph:role: osd.6 2024-09-19T05:37:03.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:37:03.063 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T05:37:03.136 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:37:03.136 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:37:03.137 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:37:03.620 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-09-19T05:37:03.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-09-19T05:37:03.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T05:37:03.756 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T05:37:03.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T05:37:03.854 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T05:37:03.854 INFO:tasks.ceph:role: osd.7 2024-09-19T05:37:03.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:37:03.854 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T05:37:03.925 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T05:37:03.925 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T05:37:03.925 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T05:37:03.926 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T05:37:03.926 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T05:37:03.926 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-09-19T05:37:03.926 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T05:37:03.926 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T05:37:03.926 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T05:37:03.926 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T05:37:04.418 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-09-19T05:37:04.420 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-09-19T05:37:04.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T05:37:04.537 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T05:37:04.569 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:37:04.664 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:04.660+0000 7fc45cc16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T05:37:04.664 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:04.661+0000 7fc45cc16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T05:37:04.664 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:04.661+0000 7fc45cc16640 -1 bdev(0x56237b543800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T05:37:04.664 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:04.661+0000 7fc45cc16640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T05:37:07.573 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T05:37:07.603 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:37:07.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:07.691+0000 7f4a0c94d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T05:37:07.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:07.691+0000 7f4a0c94d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T05:37:07.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:07.691+0000 7f4a0c94d640 -1 bdev(0x55a53ed5b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T05:37:07.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:07.691+0000 7f4a0c94d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T05:37:10.859 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T05:37:10.889 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:37:10.979 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:10.976+0000 7f622bc1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T05:37:10.979 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:10.976+0000 7f622bc1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T05:37:10.979 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:10.976+0000 7f622bc1c640 -1 bdev(0x55dbb72e9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T05:37:10.979 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:10.976+0000 7f622bc1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T05:37:12.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:12.007 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:14.142 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T05:37:14.171 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:37:14.260 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:14.257+0000 7fd132534640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T05:37:14.260 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:14.257+0000 7fd132534640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T05:37:14.260 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:14.257+0000 7fd132534640 -1 bdev(0x5574f9fd3800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T05:37:14.260 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:14.257+0000 7fd132534640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T05:37:17.176 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T05:37:17.204 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T05:37:17.205 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T05:37:17.234 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-19T05:37:17.304 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.304 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-19T05:37:17.371 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.372 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-19T05:37:17.438 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.438 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T05:37:17.506 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.506 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T05:37:17.572 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T05:37:17.638 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:17.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T05:37:17.704 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:17.704 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T05:37:17.734 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:17.734 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-19T05:37:17.803 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:17.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-19T05:37:17.871 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:17.871 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-19T05:37:17.939 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:17.939 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T05:37:18.006 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:18.006 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T05:37:18.073 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:18.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T05:37:18.140 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:18.140 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T05:37:18.206 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:18.206 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T05:37:18.224 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T05:37:18.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T05:37:18.267 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T05:37:18.290 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBsuOtm1B1lGhAAOxwq2Hw7WDiWV/AhYwixzA== 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBsuOtmDHySIRAAMghTZF/NFaxndW3QPrJLQg== 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBsuOtmkEGcKBAApHj5yLzowmjuVV2/SEuxuQ== 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.e] 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBsuOtmLX+kLxAA8AE2EGuyDQVlYAs59/hBTA== 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBwuOtm4aXAGxAAodRJ9haeLpgNL+gHZuUWYw== 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBzuOtm520POxAAlb0NfZihYgH4twiJBjhS7g== 2024-09-19T05:37:18.291 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQB3uOtmdkSNDxAAksbM4yhC8kjL+4BTzq01rg== 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQB6uOtmnud6HxAAAtwK3S/FIQ539Ph3bss1YQ== 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBsuOtmG6hYHhAAD67do2fM4+fdkSaJTfzX3Q== 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBsuOtmIy96NBAAHJVLdmDjDZ9DvEJVmu/Aig== 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBsuOtmDOuIOxAAHiltDvZzkYr+9h1KlUZv6A== 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.f] 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBtuOtmOHnzBhAAQ9nAZsKt1q9oN81bb3pjSQ== 2024-09-19T05:37:18.292 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCAuOtmxpN/JxAAwXcH2fJxPLq7moqCBg59iQ== 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCDuOtmt9BOKRAAuYIIl9T+79ioJ7GKdOh3TA== 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCGuOtmmIxNOhAAOa8PxvsckcIth7eNzZkKPg== 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCKuOtmOVB0DxAAEbyz2WT6l5xclc/SjpMcIw== 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-09-19T05:37:18.293 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBtuOtmJjkJCxAAve4wSrcfEOaIwdZZB8zZGQ== 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBsuOtm1B1lGhAAOxwq2Hw7WDiWV/AhYwixzA== 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBsuOtmDHySIRAAMghTZF/NFaxndW3QPrJLQg== 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBsuOtmkEGcKBAApHj5yLzowmjuVV2/SEuxuQ== 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.e] 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBsuOtmLX+kLxAA8AE2EGuyDQVlYAs59/hBTA== 2024-09-19T05:37:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBwuOtm4aXAGxAAodRJ9haeLpgNL+gHZuUWYw== 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBzuOtm520POxAAlb0NfZihYgH4twiJBjhS7g== 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQB3uOtmdkSNDxAAksbM4yhC8kjL+4BTzq01rg== 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQB6uOtmnud6HxAAAtwK3S/FIQ539Ph3bss1YQ== 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBsuOtmG6hYHhAAD67do2fM4+fdkSaJTfzX3Q== 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBsuOtmIy96NBAAHJVLdmDjDZ9DvEJVmu/Aig== 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-19T05:37:18.296 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBsuOtmDOuIOxAAHiltDvZzkYr+9h1KlUZv6A== 2024-09-19T05:37:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.f] 2024-09-19T05:37:18.297 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBtuOtmOHnzBhAAQ9nAZsKt1q9oN81bb3pjSQ== 2024-09-19T05:37:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-09-19T05:37:18.297 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQCAuOtmxpN/JxAAwXcH2fJxPLq7moqCBg59iQ== 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQCDuOtmt9BOKRAAuYIIl9T+79ioJ7GKdOh3TA== 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQCGuOtmmIxNOhAAOa8PxvsckcIth7eNzZkKPg== 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQCKuOtmOVB0DxAAEbyz2WT6l5xclc/SjpMcIw== 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-19T05:37:18.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBtuOtmJjkJCxAAve4wSrcfEOaIwdZZB8zZGQ== 2024-09-19T05:37:18.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:37:18.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:37:18.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.393 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.505 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.558 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.613 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.664 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.716 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.769 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:37:18.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T05:37:18.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.824 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.880 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.933 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.935 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T05:37:18.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:18.992 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:19.043 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:19.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:19.095 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:19.098 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:19.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:19.150 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T05:37:19.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:37:19.203 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T05:37:19.256 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T05:37:19.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T05:37:19.282 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T05:37:19.379 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T05:37:19.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T05:37:19.427 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T05:37:19.522 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T05:37:19.547 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T05:37:19.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T05:37:19.708 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T05:37:19.732 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:37:19.734 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T05:37:19.787 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T05:37:19.788 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T05:37:19.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T05:37:19.790 INFO:tasks.ceph.mon.a:Started 2024-09-19T05:37:19.790 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T05:37:19.791 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T05:37:19.830 INFO:tasks.ceph.mon.b:Started 2024-09-19T05:37:19.830 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T05:37:19.830 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T05:37:19.832 INFO:tasks.ceph.mon.c:Started 2024-09-19T05:37:19.832 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T05:37:19.832 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T05:37:19.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T05:37:19.835 INFO:tasks.ceph.mgr.y:Started 2024-09-19T05:37:19.835 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T05:37:19.835 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T05:37:19.837 INFO:tasks.ceph.mgr.x:Started 2024-09-19T05:37:19.837 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T05:37:19.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T05:37:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.934+0000 7f7f3ccaf640 1 Processor -- start 2024-09-19T05:37:19.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.934+0000 7f7f3ccaf640 1 -- start start 2024-09-19T05:37:19.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3ccaf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 0x7f7f38159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3ccaf640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 0x7f7f380c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3ccaf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3806f120 con 0x7f7f380c5080 2024-09-19T05:37:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3ccaf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7f38159c60 con 0x7f7f38152e70 2024-09-19T05:37:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3ccaf640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7f38070c60 con 0x7f7f3815c250 2024-09-19T05:37:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 0x7f7f38159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 0x7f7f38159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43654/0 (socket says 172.21.15.103:43654) 2024-09-19T05:37:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3659c640 1 -- 172.21.15.103:0/2908537897 learned_addr learned my addr 172.21.15.103:0/2908537897 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3659c640 1 -- 172.21.15.103:0/2908537897 >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 msgr2=0x7f7f38159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f35d9b640 1 --2- 172.21.15.103:0/2908537897 >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 0x7f7f380c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3659c640 1 -- 172.21.15.103:0/2908537897 >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 msgr2=0x7f7f38159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3659c640 1 --2- 172.21.15.103:0/2908537897 >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 0x7f7f38159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f3659c640 1 --2- 172.21.15.103:0/2908537897 >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 0x7f7f38159720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f35d9b640 1 -- 172.21.15.103:0/2908537897 >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 msgr2=0x7f7f380c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f35d9b640 1 -- 172.21.15.103:0/2908537897 >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 msgr2=0x7f7f380c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f35d9b640 1 --2- 172.21.15.103:0/2908537897 >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 0x7f7f380c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:37:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:19.935+0000 7f7f35d9b640 1 --2- 172.21.15.103:0/2908537897 >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 0x7f7f380c4b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:37:20.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042112903 0 0) 0x7f7f3806f120 con 0x7f7f380c5080 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f20003520 con 0x7f7f380c5080 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916748565 0 0) 0x7f7f20003520 con 0x7f7f380c5080 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 msgr2=0x7f7f380c4b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 --2- 172.21.15.103:0/2908537897 >> v2:172.21.15.174:3300/0 conn(0x7f7f3815c250 0x7f7f380c4b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 msgr2=0x7f7f38159720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 --2- 172.21.15.103:0/2908537897 >> v2:172.21.15.103:3300/0 conn(0x7f7f38152e70 0x7f7f38159720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f38158c60 con 0x7f7f380c5080 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f7f30001a10 con 0x7f7f380c5080 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 >> v1:172.21.15.103:6789/0 conn(0x7f7f380c5080 legacy=0x7f7f380c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200039b0 0x7f7f20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f20004800 0x7f7f20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f200051c0 0x7f7f2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38159c60 con 0x7f7f200051c0 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38070c60 con 0x7f7f20004800 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2000c0c0 con 0x7f7f200039b0 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f36d9d640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f200051c0 0x7f7f2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.100+0000 7f7f35d9b640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f20004800 0x7f7f20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.101+0000 7f7f3659c640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200039b0 0x7f7f20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.101+0000 7f7f36d9d640 1 -- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200039b0 msgr2=0x7f7f20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:20.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.101+0000 7f7f36d9d640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200039b0 0x7f7f20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.101+0000 7f7f36d9d640 1 -- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f20004800 msgr2=0x7f7f20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.101+0000 7f7f36d9d640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f20004800 0x7f7f20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.101+0000 7f7f36d9d640 1 -- 172.21.15.103:0/2908537897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f20003520 con 0x7f7f200051c0 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.102+0000 7f7f36d9d640 1 -- 172.21.15.103:0/2908537897 reap_dead start 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.102+0000 7f7f36d9d640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f200051c0 0x7f7f2000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c490 tx=0x7f7f20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd3f53f81c6ce3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.102+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000c0e0 con 0x7f7f200051c0 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.102+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3002c610 con 0x7f7f200051c0 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.102+0000 7f7f3559a640 1 -- 172.21.15.103:0/2908537897 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3002c9e0 con 0x7f7f200051c0 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.102+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/2908537897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f200051c0 msgr2=0x7f7f2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.102+0000 7f7f3ccaf640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f200051c0 0x7f7f2000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c490 tx=0x7f7f20005830 comp rx=0 tx=0).stop 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.103+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/2908537897 shutdown_connections 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.103+0000 7f7f3ccaf640 1 --2- 172.21.15.103:0/2908537897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f200051c0 0x7f7f2000b9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.103+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/2908537897 >> 172.21.15.103:0/2908537897 conn(0x7f7f3806cd20 msgr2=0x7f7f3806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:20.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.103+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/2908537897 shutdown_connections 2024-09-19T05:37:20.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.103+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/2908537897 wait complete. 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.104+0000 7f7f3ccaf640 1 Processor -- start 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.105+0000 7f7f3ccaf640 1 -- start start 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200051c0 0x7f7f38072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f38156370 0x7f7f381f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f38148210 0x7f7f381ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38159200 con 0x7f7f38148210 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f38158f20 con 0x7f7f38156370 2024-09-19T05:37:20.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7f380c47b0 con 0x7f7f200051c0 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f38148210 0x7f7f381ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3659c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200051c0 0x7f7f38072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f38148210 0x7f7f381ec7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43684/0 (socket says 172.21.15.103:43684) 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 -- 172.21.15.103:0/3724395484 learned_addr learned my addr 172.21.15.103:0/3724395484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f35d9b640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f38156370 0x7f7f381f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 -- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200051c0 msgr2=0x7f7f38072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200051c0 0x7f7f38072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 -- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f38156370 msgr2=0x7f7f381f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f38156370 0x7f7f381f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 -- 172.21.15.103:0/3724395484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f381ed0f0 con 0x7f7f38148210 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3659c640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200051c0 0x7f7f38072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f36d9d640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f38148210 0x7f7f381ec7d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7f3002b0b0 tx=0x7f7f380c6ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f26ffd640 1 -- 172.21.15.103:0/3724395484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30006b50 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f26ffd640 1 -- 172.21.15.103:0/3724395484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3003c070 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f381ed3d0 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f26ffd640 1 -- 172.21.15.103:0/3724395484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30003990 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.106+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f381f0140 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.107+0000 7f7f26ffd640 1 -- 172.21.15.103:0/3724395484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f30003b30 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.107+0000 7f7f26ffd640 1 -- 172.21.15.103:0/3724395484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7f30007370 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.107+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f3806dd20 con 0x7f7f38148210 2024-09-19T05:37:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.110+0000 7f7f26ffd640 1 -- 172.21.15.103:0/3724395484 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7f30032030 con 0x7f7f38148210 2024-09-19T05:37:20.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.172+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7f380c6780 con 0x7f7f38148210 2024-09-19T05:37:20.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.173+0000 7f7f26ffd640 1 -- 172.21.15.103:0/3724395484 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f7f3000c150 con 0x7f7f38148210 2024-09-19T05:37:20.175 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f38148210 msgr2=0x7f7f381ec7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f38148210 0x7f7f381ec7d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7f3002b0b0 tx=0x7f7f380c6ba0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 shutdown_connections 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f38148210 0x7f7f381ec7d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f38156370 0x7f7f381f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 --2- 172.21.15.103:0/3724395484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f200051c0 0x7f7f38072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 >> 172.21.15.103:0/3724395484 conn(0x7f7f3806cd20 msgr2=0x7f7f380cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 shutdown_connections 2024-09-19T05:37:20.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:20.174+0000 7f7f3ccaf640 1 -- 172.21.15.103:0/3724395484 wait complete. 2024-09-19T05:37:20.186 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T05:37:20.186 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T05:37:20.187 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:20.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T05:37:20.201 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:20.200+0000 7f2b98927040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:37:20.207 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:20.205+0000 7f30a2636040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:37:20.212 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:20.212 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T05:37:20.244 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:20.242+0000 7f2b98927040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:37:20.247 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:20.245+0000 7f30a2636040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:37:20.269 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:20.269 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T05:37:20.335 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:20.335 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T05:37:20.388 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:20.386+0000 7f30a2636040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:37:20.392 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:20.391+0000 7f2b98927040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:37:20.400 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:20.400 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T05:37:20.425 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:20.425 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T05:37:20.440 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:20.439+0000 7f30a2636040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:37:20.444 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:20.443+0000 7f2b98927040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:37:20.465 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:20.465 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T05:37:20.528 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-19T05:37:20.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T05:37:20.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 5e2c6e00-7e60-4ccc-9698-fca3ee448370 0 2024-09-19T05:37:20.603 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:20.602+0000 7f2b98927040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:37:20.609 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:20.608+0000 7f30a2636040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:37:20.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.705+0000 7efd60bc0640 1 Processor -- start 2024-09-19T05:37:20.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.705+0000 7efd60bc0640 1 -- start start 2024-09-19T05:37:20.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.706+0000 7efd60bc0640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efd5c15cad0 0x7efd5c072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.706+0000 7efd60bc0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c15e560 con 0x7efd5c06ee90 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.706+0000 7efd60bc0640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c070e50 con 0x7efd5c155260 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.706+0000 7efd60bc0640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c15be10 con 0x7efd5c15cad0 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.707+0000 7efd5ad9d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efd5c15cad0 0x7efd5c072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.707+0000 7efd5a59c640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7efd5c155260 0x7efd5c15c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:51512/0 (socket says 172.21.15.174:51512) 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.707+0000 7efd5a59c640 1 -- 172.21.15.174:0/132239689 learned_addr learned my addr 172.21.15.174:0/132239689 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.707+0000 7efd5ad9d640 1 -- 172.21.15.174:0/132239689 >> v1:172.21.15.174:6789/0 conn(0x7efd5c155260 legacy=0x7efd5c15c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.707+0000 7efd5ad9d640 1 -- 172.21.15.174:0/132239689 >> v1:172.21.15.103:6789/0 conn(0x7efd5c06ee90 legacy=0x7efd5c072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.707+0000 7efd5ad9d640 1 -- 172.21.15.174:0/132239689 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c15e800 con 0x7efd5c15cad0 2024-09-19T05:37:20.710 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd5ad9d640 1 --2- 172.21.15.174:0/132239689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c072b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd54009d90 tx=0x7efd5402a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26aa46f2cf87448e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.710 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd5959a640 1 -- 172.21.15.174:0/132239689 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54037070 con 0x7efd5c15cad0 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd5959a640 1 -- 172.21.15.174:0/132239689 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd54007740 con 0x7efd5c15cad0 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd5959a640 1 -- 172.21.15.174:0/132239689 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54007b10 con 0x7efd5c15cad0 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd60bc0640 1 -- 172.21.15.174:0/132239689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 msgr2=0x7efd5c072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd60bc0640 1 --2- 172.21.15.174:0/132239689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c072b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd54009d90 tx=0x7efd5402a780 comp rx=0 tx=0).stop 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd60bc0640 1 -- 172.21.15.174:0/132239689 shutdown_connections 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd60bc0640 1 --2- 172.21.15.174:0/132239689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c072b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.708+0000 7efd60bc0640 1 -- 172.21.15.174:0/132239689 >> 172.21.15.174:0/132239689 conn(0x7efd5c06cd20 msgr2=0x7efd5c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.709+0000 7efd60bc0640 1 -- 172.21.15.174:0/132239689 shutdown_connections 2024-09-19T05:37:20.711 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.709+0000 7efd60bc0640 1 -- 172.21.15.174:0/132239689 wait complete. 2024-09-19T05:37:20.712 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.710+0000 7efd60bc0640 1 Processor -- start 2024-09-19T05:37:20.712 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.710+0000 7efd60bc0640 1 -- start start 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd5c06ee90 0x7efd5c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd5c155260 0x7efd5c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c15f0a0 con 0x7efd5c155260 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c15edc0 con 0x7efd5c15cad0 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c0730d0 con 0x7efd5c06ee90 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.714 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd5c06ee90 0x7efd5c0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd5c06ee90 0x7efd5c0c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:43716/0 (socket says 172.21.15.174:43716) 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c0c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:51582/0 (socket says 172.21.15.174:51582) 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5a59c640 1 -- 172.21.15.174:0/1844259689 learned_addr learned my addr 172.21.15.174:0/1844259689 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd59d9b640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd5c155260 0x7efd5c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 -- 172.21.15.174:0/1844259689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd5c06ee90 msgr2=0x7efd5c0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd5c06ee90 0x7efd5c0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 -- 172.21.15.174:0/1844259689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd5c155260 msgr2=0x7efd5c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd5c155260 0x7efd5c1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 -- 172.21.15.174:0/1844259689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c0c87c0 con 0x7efd5c15cad0 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd5ad9d640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c0c6210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd54031000 tx=0x7efd54004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd4affd640 1 -- 172.21.15.174:0/1844259689 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54042020 con 0x7efd5c15cad0 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd4affd640 1 -- 172.21.15.174:0/1844259689 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd54007e60 con 0x7efd5c15cad0 2024-09-19T05:37:20.715 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c0c8a80 con 0x7efd5c15cad0 2024-09-19T05:37:20.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd4affd640 1 -- 172.21.15.174:0/1844259689 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54037040 con 0x7efd5c15cad0 2024-09-19T05:37:20.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.711+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c0c97a0 con 0x7efd5c15cad0 2024-09-19T05:37:20.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.712+0000 7efd4affd640 1 -- 172.21.15.174:0/1844259689 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efd54045020 con 0x7efd5c15cad0 2024-09-19T05:37:20.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.712+0000 7efd4affd640 1 -- 172.21.15.174:0/1844259689 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7efd5403e420 con 0x7efd5c15cad0 2024-09-19T05:37:20.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.712+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c15b8b0 con 0x7efd5c15cad0 2024-09-19T05:37:20.716 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:20.712+0000 7f2b98927040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:37:20.716 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.714+0000 7efd4affd640 1 -- 172.21.15.174:0/1844259689 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efd5404c030 con 0x7efd5c15cad0 2024-09-19T05:37:20.726 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:20.725+0000 7f30a2636040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:37:20.786 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.784+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5e2c6e00-7e60-4ccc-9698-fca3ee448370", "id": 0} v 0) -- 0x7efd5c06db70 con 0x7efd5c15cad0 2024-09-19T05:37:20.792 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.790+0000 7efd4affd640 1 -- 172.21.15.174:0/1844259689 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e2c6e00-7e60-4ccc-9698-fca3ee448370", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7efd5403d9e0 con 0x7efd5c15cad0 2024-09-19T05:37:20.792 INFO:teuthology.orchestra.run.smithi174.stdout:0 2024-09-19T05:37:20.793 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 msgr2=0x7efd5c0c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.793 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c0c6210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd54031000 tx=0x7efd54004a40 comp rx=0 tx=0).stop 2024-09-19T05:37:20.793 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 shutdown_connections 2024-09-19T05:37:20.793 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd5c15cad0 0x7efd5c0c6210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.793 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd5c155260 0x7efd5c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 --2- 172.21.15.174:0/1844259689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd5c06ee90 0x7efd5c0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 >> 172.21.15.174:0/1844259689 conn(0x7efd5c06cd20 msgr2=0x7efd5c15b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:20.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 shutdown_connections 2024-09-19T05:37:20.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.791+0000 7efd60bc0640 1 -- 172.21.15.174:0/1844259689 wait complete. 2024-09-19T05:37:20.804 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 8fff8c55-01de-40ad-81f1-750bf3f071b7 1 2024-09-19T05:37:20.901 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.899+0000 7f70e7cd7640 1 Processor -- start 2024-09-19T05:37:20.901 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.899+0000 7f70e7cd7640 1 -- start start 2024-09-19T05:37:20.902 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e7cd7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70e0152110 0x7f70e0073c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.902 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e7cd7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70e0070bc0 0x7f70e0162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.902 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e7cd7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e0157dc0 con 0x7f70e006d840 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e7cd7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f70e00737b0 con 0x7f70e0070bc0 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e7cd7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f70e0073160 con 0x7f70e0152110 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e5a73640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70e0152110 0x7f70e0073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e5a73640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70e0152110 0x7f70e0073c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:51594/0 (socket says 172.21.15.174:51594) 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e5a73640 1 -- 172.21.15.174:0/3498159372 learned_addr learned my addr 172.21.15.174:0/3498159372 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e6274640 1 --2- 172.21.15.174:0/3498159372 >> v2:172.21.15.103:3300/0 conn(0x7f70e0070bc0 0x7f70e0162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e5a73640 1 -- 172.21.15.174:0/3498159372 >> v2:172.21.15.103:3300/0 conn(0x7f70e0070bc0 msgr2=0x7f70e0162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e5a73640 1 --2- 172.21.15.174:0/3498159372 >> v2:172.21.15.103:3300/0 conn(0x7f70e0070bc0 0x7f70e0162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e5a73640 1 -- 172.21.15.174:0/3498159372 >> v1:172.21.15.103:6789/0 conn(0x7f70e006d840 legacy=0x7f70e0072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.900+0000 7f70e5a73640 1 -- 172.21.15.174:0/3498159372 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e0073440 con 0x7f70e0152110 2024-09-19T05:37:20.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.901+0000 7f70e5a73640 1 --2- 172.21.15.174:0/3498159372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 0x7f70e0073c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70e00684b0 tx=0x7f70dc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf13e4cf09f2140 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.901+0000 7f70e4a71640 1 -- 172.21.15.174:0/3498159372 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc037070 con 0x7f70e0152110 2024-09-19T05:37:20.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.901+0000 7f70e4a71640 1 -- 172.21.15.174:0/3498159372 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70dc032440 con 0x7f70e0152110 2024-09-19T05:37:20.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e4a71640 1 -- 172.21.15.174:0/3498159372 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc032810 con 0x7f70e0152110 2024-09-19T05:37:20.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 -- 172.21.15.174:0/3498159372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 msgr2=0x7f70e0073c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 --2- 172.21.15.174:0/3498159372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 0x7f70e0073c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70e00684b0 tx=0x7f70dc02a270 comp rx=0 tx=0).stop 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 -- 172.21.15.174:0/3498159372 shutdown_connections 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 --2- 172.21.15.174:0/3498159372 >> v2:172.21.15.103:3300/0 conn(0x7f70e0070bc0 0x7f70e0162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 --2- 172.21.15.174:0/3498159372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 0x7f70e0073c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 -- 172.21.15.174:0/3498159372 >> 172.21.15.174:0/3498159372 conn(0x7f70e006cd20 msgr2=0x7f70e006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 -- 172.21.15.174:0/3498159372 shutdown_connections 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.902+0000 7f70e7cd7640 1 -- 172.21.15.174:0/3498159372 wait complete. 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.903+0000 7f70e7cd7640 1 Processor -- start 2024-09-19T05:37:20.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.903+0000 7f70e7cd7640 1 -- start start 2024-09-19T05:37:20.908 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e7cd7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e006d840 0x7f70e014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.908 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e7cd7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70e0070bc0 0x7f70e0150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.908 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e7cd7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 0x7f70e01512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:20.908 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e7cd7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70e00c45b0 con 0x7f70e006d840 2024-09-19T05:37:20.908 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e7cd7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f70e00c8040 con 0x7f70e0152110 2024-09-19T05:37:20.908 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e7cd7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f70e00c4730 con 0x7f70e0070bc0 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e5a73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e006d840 0x7f70e014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e6274640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 0x7f70e01512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e5272640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70e0070bc0 0x7f70e0150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e5a73640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e006d840 0x7f70e014cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.174:48262/0 (socket says 172.21.15.174:48262) 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e5a73640 1 -- 172.21.15.174:0/2835229065 learned_addr learned my addr 172.21.15.174:0/2835229065 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e5a73640 1 -- 172.21.15.174:0/2835229065 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70e0070bc0 msgr2=0x7f70e0150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.904+0000 7f70e5a73640 1 --2- 172.21.15.174:0/2835229065 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70e0070bc0 0x7f70e0150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70e5a73640 1 -- 172.21.15.174:0/2835229065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 msgr2=0x7f70e01512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70e5a73640 1 --2- 172.21.15.174:0/2835229065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 0x7f70e01512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70e5a73640 1 -- 172.21.15.174:0/2835229065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e014f9d0 con 0x7f70e006d840 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70e5a73640 1 --2- 172.21.15.174:0/2835229065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e006d840 0x7f70e014cd60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70dc02a2b0 tx=0x7f70dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70d67fc640 1 -- 172.21.15.174:0/2835229065 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc037040 con 0x7f70e006d840 2024-09-19T05:37:20.909 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70d67fc640 1 -- 172.21.15.174:0/2835229065 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70dc042070 con 0x7f70e006d840 2024-09-19T05:37:20.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e01ef7e0 con 0x7f70e006d840 2024-09-19T05:37:20.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70d67fc640 1 -- 172.21.15.174:0/2835229065 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc030880 con 0x7f70e006d840 2024-09-19T05:37:20.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e014fc40 con 0x7f70e006d840 2024-09-19T05:37:20.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70d67fc640 1 -- 172.21.15.174:0/2835229065 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f70dc030a20 con 0x7f70e006d840 2024-09-19T05:37:20.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.905+0000 7f70d67fc640 1 -- 172.21.15.174:0/2835229065 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f70dc047bd0 con 0x7f70e006d840 2024-09-19T05:37:20.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.906+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e0150a60 con 0x7f70e006d840 2024-09-19T05:37:20.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.908+0000 7f70d67fc640 1 -- 172.21.15.174:0/2835229065 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f70e0150a60 con 0x7f70e006d840 2024-09-19T05:37:20.977 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.975+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8fff8c55-01de-40ad-81f1-750bf3f071b7", "id": 1} v 0) -- 0x7f70e0073c40 con 0x7f70e006d840 2024-09-19T05:37:20.982 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.980+0000 7f70d67fc640 1 -- 172.21.15.174:0/2835229065 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fff8c55-01de-40ad-81f1-750bf3f071b7", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f70dc047e20 con 0x7f70e006d840 2024-09-19T05:37:20.982 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-09-19T05:37:20.983 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e006d840 msgr2=0x7f70e014cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:20.983 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 --2- 172.21.15.174:0/2835229065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e006d840 0x7f70e014cd60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70dc02a2b0 tx=0x7f70dc0046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.983 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 shutdown_connections 2024-09-19T05:37:20.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 --2- 172.21.15.174:0/2835229065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70e0152110 0x7f70e01512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 --2- 172.21.15.174:0/2835229065 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70e0070bc0 0x7f70e0150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 --2- 172.21.15.174:0/2835229065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e006d840 0x7f70e014cd60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:20.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 >> 172.21.15.174:0/2835229065 conn(0x7f70e006cd20 msgr2=0x7f70e00c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:20.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 shutdown_connections 2024-09-19T05:37:20.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:20.981+0000 7f70e7cd7640 1 -- 172.21.15.174:0/2835229065 wait complete. 2024-09-19T05:37:20.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new df45abe9-48ad-474d-ae64-3afa446097e3 2 2024-09-19T05:37:21.036 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:21.035+0000 7f2b98927040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:37:21.065 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:21.064+0000 7f30a2636040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:37:21.089 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:21.087+0000 7f2b98927040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:37:21.095 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.090+0000 7f199872a640 1 Processor -- start 2024-09-19T05:37:21.095 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.090+0000 7f199872a640 1 -- start start 2024-09-19T05:37:21.095 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f199872a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1990152110 0x7f1990073c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.095 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f199872a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f199006d840 0x7f1990072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.095 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f199872a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1990157dc0 con 0x7f1990070bc0 2024-09-19T05:37:21.095 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f199872a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f19900737b0 con 0x7f199006d840 2024-09-19T05:37:21.095 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f199872a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1990073160 con 0x7f1990152110 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f1995cc5640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f199006d840 0x7f1990072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f1996cc7640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1990070bc0 0x7f199015b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:51522/0 (socket says 172.21.15.174:51522) 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f1996cc7640 1 -- 172.21.15.174:0/2177138316 learned_addr learned my addr 172.21.15.174:0/2177138316 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f19964c6640 1 --2- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1990152110 0x7f1990073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f1995cc5640 1 -- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1990152110 msgr2=0x7f1990073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f1995cc5640 1 --2- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1990152110 0x7f1990073c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f1995cc5640 1 -- 172.21.15.174:0/2177138316 >> v1:172.21.15.174:6789/0 conn(0x7f1990070bc0 legacy=0x7f199015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f1995cc5640 1 -- 172.21.15.174:0/2177138316 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1990073440 con 0x7f199006d840 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.091+0000 7f19954c4640 1 -- 172.21.15.174:0/2177138316 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174939741 0 0) 0x7f1990157dc0 con 0x7f1990070bc0 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.092+0000 7f1995cc5640 1 --2- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f199006d840 0x7f1990072480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19800097a0 tx=0x7f198002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d81ec06036d01b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.092+0000 7f19954c4640 1 -- 172.21.15.174:0/2177138316 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980037070 con 0x7f199006d840 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.092+0000 7f19954c4640 1 -- 172.21.15.174:0/2177138316 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1980032440 con 0x7f199006d840 2024-09-19T05:37:21.096 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.092+0000 7f19954c4640 1 -- 172.21.15.174:0/2177138316 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980032810 con 0x7f199006d840 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 -- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f199006d840 msgr2=0x7f1990072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 --2- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f199006d840 0x7f1990072480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19800097a0 tx=0x7f198002a180 comp rx=0 tx=0).stop 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 -- 172.21.15.174:0/2177138316 shutdown_connections 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 --2- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f199006d840 0x7f1990072480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 --2- 172.21.15.174:0/2177138316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1990152110 0x7f1990073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 -- 172.21.15.174:0/2177138316 >> 172.21.15.174:0/2177138316 conn(0x7f199006cd20 msgr2=0x7f199006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 -- 172.21.15.174:0/2177138316 shutdown_connections 2024-09-19T05:37:21.097 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.093+0000 7f199872a640 1 -- 172.21.15.174:0/2177138316 wait complete. 2024-09-19T05:37:21.099 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.094+0000 7f199872a640 1 Processor -- start 2024-09-19T05:37:21.099 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.094+0000 7f199872a640 1 -- start start 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f199006d840 0x7f199014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1990070bc0 0x7f1990150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1990152110 0x7f199013fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f19900c45b0 con 0x7f1990070bc0 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f19900c8040 con 0x7f1990152110 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f19900c4730 con 0x7f199006d840 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f199006d840 0x7f199014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f1996cc7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1990152110 0x7f199013fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f199006d840 0x7f199014c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:43742/0 (socket says 172.21.15.174:43742) 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f1996cc7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1990152110 0x7f199013fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:51602/0 (socket says 172.21.15.174:51602) 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 -- 172.21.15.174:0/409525422 learned_addr learned my addr 172.21.15.174:0/409525422 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f1995cc5640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1990070bc0 0x7f1990150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 -- 172.21.15.174:0/409525422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1990152110 msgr2=0x7f199013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1990152110 0x7f199013fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 -- 172.21.15.174:0/409525422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1990070bc0 msgr2=0x7f1990150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1990070bc0 0x7f1990150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 -- 172.21.15.174:0/409525422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199014dfe0 con 0x7f199006d840 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f1995cc5640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1990070bc0 0x7f1990150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f19964c6640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f199006d840 0x7f199014c620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f198c00e870 tx=0x7f198c00ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f1986ffd640 1 -- 172.21.15.174:0/409525422 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c017070 con 0x7f199006d840 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f1986ffd640 1 -- 172.21.15.174:0/409525422 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c00c8e0 con 0x7f199006d840 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f1986ffd640 1 -- 172.21.15.174:0/409525422 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c00ccd0 con 0x7f199006d840 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1990154ff0 con 0x7f199006d840 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.095+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1990153970 con 0x7f199006d840 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.096+0000 7f1986ffd640 1 -- 172.21.15.174:0/409525422 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f198c01a070 con 0x7f199006d840 2024-09-19T05:37:21.101 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.096+0000 7f1986ffd640 1 -- 172.21.15.174:0/409525422 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f198c013890 con 0x7f199006d840 2024-09-19T05:37:21.102 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.097+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19900c5d20 con 0x7f199006d840 2024-09-19T05:37:21.102 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.099+0000 7f1986ffd640 1 -- 172.21.15.174:0/409525422 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f19900c5d20 con 0x7f199006d840 2024-09-19T05:37:21.128 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:21.126+0000 7f30a2636040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:37:21.186 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.185+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "df45abe9-48ad-474d-ae64-3afa446097e3", "id": 2} v 0) -- 0x7f19900c4d50 con 0x7f199006d840 2024-09-19T05:37:21.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f1986ffd640 1 -- 172.21.15.174:0/409525422 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df45abe9-48ad-474d-ae64-3afa446097e3", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f19900c4d50 con 0x7f199006d840 2024-09-19T05:37:21.189 INFO:teuthology.orchestra.run.smithi174.stdout:2 2024-09-19T05:37:21.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f199006d840 msgr2=0x7f199014c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f199872a640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f199006d840 0x7f199014c620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f198c00e870 tx=0x7f198c00ec70 comp rx=0 tx=0).stop 2024-09-19T05:37:21.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 shutdown_connections 2024-09-19T05:37:21.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f199872a640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1990152110 0x7f199013fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f199872a640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1990070bc0 0x7f1990150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f199872a640 1 --2- 172.21.15.174:0/409525422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f199006d840 0x7f199014c620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.188+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 >> 172.21.15.174:0/409525422 conn(0x7f199006cd20 msgr2=0x7f19900c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.189+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 shutdown_connections 2024-09-19T05:37:21.191 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.189+0000 7f199872a640 1 -- 172.21.15.174:0/409525422 wait complete. 2024-09-19T05:37:21.201 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 76722d91-873a-4ddf-bee5-046bee9910e2 3 2024-09-19T05:37:21.238 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:21.237+0000 7f2b98927040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:37:21.290 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:21.289+0000 7f30a2636040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:37:21.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.299+0000 7f5252b9f640 1 Processor -- start 2024-09-19T05:37:21.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.299+0000 7f5252b9f640 1 -- start start 2024-09-19T05:37:21.302 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f5252b9f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c06d840 0x7f524c072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.302 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f5252b9f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f524c070bc0 0x7f524c0729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.302 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f5252b9f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524c157dc0 con 0x7f524c152110 2024-09-19T05:37:21.302 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f5252b9f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f524c0737b0 con 0x7f524c070bc0 2024-09-19T05:37:21.302 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f5252b9f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f524c072f00 con 0x7f524c06d840 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f525113c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f524c070bc0 0x7f524c0729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f524bfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c06d840 0x7f524c072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f525113c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f524c070bc0 0x7f524c0729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:51610/0 (socket says 172.21.15.174:51610) 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f525113c640 1 -- 172.21.15.174:0/3136580798 learned_addr learned my addr 172.21.15.174:0/3136580798 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f525113c640 1 -- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c06d840 msgr2=0x7f524c072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f525113c640 1 --2- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c06d840 0x7f524c072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f525113c640 1 -- 172.21.15.174:0/3136580798 >> v1:172.21.15.103:6789/0 conn(0x7f524c152110 legacy=0x7f524c073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f525113c640 1 -- 172.21.15.174:0/3136580798 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c073160 con 0x7f524c070bc0 2024-09-19T05:37:21.303 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.300+0000 7f524bfff640 1 --2- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c06d840 0x7f524c072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.301+0000 7f525113c640 1 --2- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c070bc0 0x7f524c0729c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f524400d150 tx=0x7f524402c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8e21a97050ceac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.301+0000 7f524b7fe640 1 -- 172.21.15.174:0/3136580798 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244009600 con 0x7f524c070bc0 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.301+0000 7f524b7fe640 1 -- 172.21.15.174:0/3136580798 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5244037070 con 0x7f524c070bc0 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.301+0000 7f524b7fe640 1 -- 172.21.15.174:0/3136580798 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52440099c0 con 0x7f524c070bc0 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 -- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c070bc0 msgr2=0x7f524c0729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 --2- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c070bc0 0x7f524c0729c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f524400d150 tx=0x7f524402c930 comp rx=0 tx=0).stop 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 -- 172.21.15.174:0/3136580798 shutdown_connections 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 --2- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c070bc0 0x7f524c0729c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 --2- 172.21.15.174:0/3136580798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c06d840 0x7f524c072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.306 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 -- 172.21.15.174:0/3136580798 >> 172.21.15.174:0/3136580798 conn(0x7f524c06cd20 msgr2=0x7f524c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.306 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 -- 172.21.15.174:0/3136580798 shutdown_connections 2024-09-19T05:37:21.306 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.302+0000 7f5252b9f640 1 -- 172.21.15.174:0/3136580798 wait complete. 2024-09-19T05:37:21.306 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.303+0000 7f5252b9f640 1 Processor -- start 2024-09-19T05:37:21.306 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.303+0000 7f5252b9f640 1 -- start start 2024-09-19T05:37:21.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f5252b9f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c06d840 0x7f524c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f5252b9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f524c070bc0 0x7f524c1f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f5252b9f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c152110 0x7f524c1e39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f5252b9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f524c0c8040 con 0x7f524c070bc0 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f5252b9f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f524c06ee90 con 0x7f524c06d840 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f5252b9f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f524c074350 con 0x7f524c152110 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c152110 0x7f524c1e39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525093b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c06d840 0x7f524c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c152110 0x7f524c1e39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:43764/0 (socket says 172.21.15.174:43764) 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 -- 172.21.15.174:0/3094788384 learned_addr learned my addr 172.21.15.174:0/3094788384 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f524bfff640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f524c070bc0 0x7f524c1f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 -- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c06d840 msgr2=0x7f524c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c06d840 0x7f524c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 -- 172.21.15.174:0/3094788384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f524c070bc0 msgr2=0x7f524c1f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f524c070bc0 0x7f524c1f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 -- 172.21.15.174:0/3094788384 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c1e2780 con 0x7f524c152110 2024-09-19T05:37:21.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525093b640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c06d840 0x7f524c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f525113c640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c152110 0x7f524c1e39b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f524400d270 tx=0x7f5244004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.304+0000 7f52497fa640 1 -- 172.21.15.174:0/3094788384 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244009dc0 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.305+0000 7f52497fa640 1 -- 172.21.15.174:0/3094788384 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5244032420 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.305+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524c1577d0 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.305+0000 7f52497fa640 1 -- 172.21.15.174:0/3094788384 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244032810 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.305+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f524c1e4e90 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.305+0000 7f52497fa640 1 -- 172.21.15.174:0/3094788384 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5244043020 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.305+0000 7f52497fa640 1 -- 172.21.15.174:0/3094788384 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5244045c50 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.305+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f524c0c45b0 con 0x7f524c152110 2024-09-19T05:37:21.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.308+0000 7f52497fa640 1 -- 172.21.15.174:0/3094788384 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f52440093e0 con 0x7f524c152110 2024-09-19T05:37:21.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.377+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "76722d91-873a-4ddf-bee5-046bee9910e2", "id": 3} v 0) -- 0x7f524c068840 con 0x7f524c152110 2024-09-19T05:37:21.382 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.381+0000 7f52497fa640 1 -- 172.21.15.174:0/3094788384 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76722d91-873a-4ddf-bee5-046bee9910e2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5244045780 con 0x7f524c152110 2024-09-19T05:37:21.382 INFO:teuthology.orchestra.run.smithi174.stdout:3 2024-09-19T05:37:21.383 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c152110 msgr2=0x7f524c1e39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c152110 0x7f524c1e39b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f524400d270 tx=0x7f5244004a40 comp rx=0 tx=0).stop 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 shutdown_connections 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f524c152110 0x7f524c1e39b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f524c070bc0 0x7f524c1f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 --2- 172.21.15.174:0/3094788384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f524c06d840 0x7f524c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 >> 172.21.15.174:0/3094788384 conn(0x7f524c06cd20 msgr2=0x7f524c0c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 shutdown_connections 2024-09-19T05:37:21.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.382+0000 7f5252b9f640 1 -- 172.21.15.174:0/3094788384 wait complete. 2024-09-19T05:37:21.394 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 9fef5698-824f-4299-a7a6-86403a8063e4 4 2024-09-19T05:37:21.493 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.491+0000 7ffa2b331640 1 Processor -- start 2024-09-19T05:37:21.493 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.491+0000 7ffa2b331640 1 -- start start 2024-09-19T05:37:21.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa2b331640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa2406d230 0x7ffa2415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa2b331640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa2415f210 con 0x7ffa24070620 2024-09-19T05:37:21.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa2b331640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa2415ad80 con 0x7ffa2406d610 2024-09-19T05:37:21.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa2b331640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ffa24070b60 con 0x7ffa2406d230 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa288cc640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ffa2406d610 0x7ffa240c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:43300/0 (socket says 172.21.15.174:43300) 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa288cc640 1 -- 172.21.15.174:0/466039632 learned_addr learned my addr 172.21.15.174:0/466039632 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa290cd640 1 --2- 172.21.15.174:0/466039632 >> v2:172.21.15.103:3300/0 conn(0x7ffa2406d230 0x7ffa2415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa1bfff640 1 -- 172.21.15.174:0/466039632 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475238365 0 0) 0x7ffa2415ad80 con 0x7ffa2406d610 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa1bfff640 1 -- 172.21.15.174:0/466039632 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa10003520 con 0x7ffa2406d610 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa1bfff640 1 -- 172.21.15.174:0/466039632 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872491880 0 0) 0x7ffa2415f210 con 0x7ffa24070620 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa1bfff640 1 -- 172.21.15.174:0/466039632 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa2415ad80 con 0x7ffa24070620 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa290cd640 1 -- 172.21.15.174:0/466039632 >> v1:172.21.15.174:6789/0 conn(0x7ffa2406d610 legacy=0x7ffa240c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa290cd640 1 -- 172.21.15.174:0/466039632 >> v1:172.21.15.103:6789/0 conn(0x7ffa24070620 legacy=0x7ffa24154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.492+0000 7ffa290cd640 1 -- 172.21.15.174:0/466039632 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2415b040 con 0x7ffa2406d230 2024-09-19T05:37:21.497 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.493+0000 7ffa290cd640 1 --2- 172.21.15.174:0/466039632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa2406d230 0x7ffa2415ecd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa140097a0 tx=0x7ffa1402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f4c166c3bb6926 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.493+0000 7ffa1bfff640 1 -- 172.21.15.174:0/466039632 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14037070 con 0x7ffa2406d230 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.493+0000 7ffa1bfff640 1 -- 172.21.15.174:0/466039632 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14032440 con 0x7ffa2406d230 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.493+0000 7ffa1bfff640 1 -- 172.21.15.174:0/466039632 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14032810 con 0x7ffa2406d230 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.494+0000 7ffa2b331640 1 -- 172.21.15.174:0/466039632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa2406d230 msgr2=0x7ffa2415ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.494+0000 7ffa2b331640 1 --2- 172.21.15.174:0/466039632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa2406d230 0x7ffa2415ecd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa140097a0 tx=0x7ffa1402a230 comp rx=0 tx=0).stop 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.494+0000 7ffa2b331640 1 -- 172.21.15.174:0/466039632 shutdown_connections 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.494+0000 7ffa2b331640 1 --2- 172.21.15.174:0/466039632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa2406d230 0x7ffa2415ecd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.494+0000 7ffa2b331640 1 -- 172.21.15.174:0/466039632 >> 172.21.15.174:0/466039632 conn(0x7ffa240cd9c0 msgr2=0x7ffa240cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.494+0000 7ffa2b331640 1 -- 172.21.15.174:0/466039632 shutdown_connections 2024-09-19T05:37:21.498 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.494+0000 7ffa2b331640 1 -- 172.21.15.174:0/466039632 wait complete. 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.495+0000 7ffa2b331640 1 Processor -- start 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.495+0000 7ffa2b331640 1 -- start start 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa2b331640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2406d230 0x7ffa240c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa2b331640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa2406d610 0x7ffa241565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa2b331640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa24070620 0x7ffa241f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa2b331640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2415b8e0 con 0x7ffa24070620 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa2b331640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2415b600 con 0x7ffa2406d230 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa2b331640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa2406f850 con 0x7ffa2406d610 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2406d230 0x7ffa240c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.501 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2406d230 0x7ffa240c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:54106/0 (socket says 172.21.15.174:54106) 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa288cc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa2406d610 0x7ffa241565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 -- 172.21.15.174:0/3720422526 learned_addr learned my addr 172.21.15.174:0/3720422526 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa298ce640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa24070620 0x7ffa241f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 -- 172.21.15.174:0/3720422526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa2406d610 msgr2=0x7ffa241565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa2406d610 0x7ffa241565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 -- 172.21.15.174:0/3720422526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa24070620 msgr2=0x7ffa241f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa24070620 0x7ffa241f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa290cd640 1 -- 172.21.15.174:0/3720422526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa241f1da0 con 0x7ffa2406d230 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.496+0000 7ffa298ce640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa24070620 0x7ffa241f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa290cd640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2406d230 0x7ffa240c9980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffa14035040 tx=0x7ffa140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa19ffb640 1 -- 172.21.15.174:0/3720422526 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14041030 con 0x7ffa2406d230 2024-09-19T05:37:21.502 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa19ffb640 1 -- 172.21.15.174:0/3720422526 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1403d4e0 con 0x7ffa2406d230 2024-09-19T05:37:21.503 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa19ffb640 1 -- 172.21.15.174:0/3720422526 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14037040 con 0x7ffa2406d230 2024-09-19T05:37:21.503 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa240cab70 con 0x7ffa2406d230 2024-09-19T05:37:21.503 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa240c8ea0 con 0x7ffa2406d230 2024-09-19T05:37:21.503 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa19ffb640 1 -- 172.21.15.174:0/3720422526 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa14044070 con 0x7ffa2406d230 2024-09-19T05:37:21.503 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.497+0000 7ffa19ffb640 1 -- 172.21.15.174:0/3720422526 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ffa14046bf0 con 0x7ffa2406d230 2024-09-19T05:37:21.503 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.498+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2415ecd0 con 0x7ffa2406d230 2024-09-19T05:37:21.503 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.500+0000 7ffa19ffb640 1 -- 172.21.15.174:0/3720422526 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ffa140466e0 con 0x7ffa2406d230 2024-09-19T05:37:21.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.569+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9fef5698-824f-4299-a7a6-86403a8063e4", "id": 4} v 0) -- 0x7ffa2406fc20 con 0x7ffa2406d230 2024-09-19T05:37:21.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.574+0000 7ffa19ffb640 1 -- 172.21.15.174:0/3720422526 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fef5698-824f-4299-a7a6-86403a8063e4", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ffa140468c0 con 0x7ffa2406d230 2024-09-19T05:37:21.576 INFO:teuthology.orchestra.run.smithi174.stdout:4 2024-09-19T05:37:21.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2406d230 msgr2=0x7ffa240c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2406d230 0x7ffa240c9980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffa14035040 tx=0x7ffa140046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 shutdown_connections 2024-09-19T05:37:21.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa24070620 0x7ffa241f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.578 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa2406d610 0x7ffa241565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.578 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 --2- 172.21.15.174:0/3720422526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2406d230 0x7ffa240c9980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.578 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 >> 172.21.15.174:0/3720422526 conn(0x7ffa240cd9c0 msgr2=0x7ffa241548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.578 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 shutdown_connections 2024-09-19T05:37:21.578 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.575+0000 7ffa2b331640 1 -- 172.21.15.174:0/3720422526 wait complete. 2024-09-19T05:37:21.587 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 99635d2e-a5f2-4993-8723-e9fdcc509ce2 5 2024-09-19T05:37:21.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.683+0000 7f8b49c77640 1 Processor -- start 2024-09-19T05:37:21.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.683+0000 7f8b49c77640 1 -- start start 2024-09-19T05:37:21.687 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b49c77640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b44153020 0x7f8b440c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.687 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b49c77640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440cac60 0x7f8b44159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.687 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b49c77640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b440c6d10 con 0x7f8b440c5550 2024-09-19T05:37:21.687 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b49c77640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8b440c7b00 con 0x7f8b44153020 2024-09-19T05:37:21.687 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b49c77640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8b440c6f80 con 0x7f8b440cac60 2024-09-19T05:37:21.687 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b43fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440cac60 0x7f8b44159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.687 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b437fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b44153020 0x7f8b440c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b43fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440cac60 0x7f8b44159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35432/0 (socket says 172.21.15.174:35432) 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b43fff640 1 -- 172.21.15.174:0/1887776870 learned_addr learned my addr 172.21.15.174:0/1887776870 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.684+0000 7f8b42ffd640 1 --1- 172.21.15.174:0/1887776870 >> v1:172.21.15.174:6789/0 conn(0x7f8b440c5550 0x7f8b4406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:43304/0 (socket says 172.21.15.174:43304) 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b43fff640 1 -- 172.21.15.174:0/1887776870 >> v2:172.21.15.174:3300/0 conn(0x7f8b44153020 msgr2=0x7f8b440c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b43fff640 1 --2- 172.21.15.174:0/1887776870 >> v2:172.21.15.174:3300/0 conn(0x7f8b44153020 0x7f8b440c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b43fff640 1 -- 172.21.15.174:0/1887776870 >> v1:172.21.15.174:6789/0 conn(0x7f8b440c5550 legacy=0x7f8b4406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b43fff640 1 -- 172.21.15.174:0/1887776870 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b440c7260 con 0x7f8b440cac60 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b427fc640 1 -- 172.21.15.174:0/1887776870 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563599932 0 0) 0x7f8b440c6d10 con 0x7f8b440c5550 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b437fe640 1 --2- 172.21.15.174:0/1887776870 >> v2:172.21.15.174:3300/0 conn(0x7f8b44153020 0x7f8b440c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b43fff640 1 --2- 172.21.15.174:0/1887776870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440cac60 0x7f8b44159250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=638044416602ac18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b427fc640 1 -- 172.21.15.174:0/1887776870 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c037070 con 0x7f8b440cac60 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b427fc640 1 -- 172.21.15.174:0/1887776870 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c02ae50 con 0x7f8b440cac60 2024-09-19T05:37:21.688 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.685+0000 7f8b427fc640 1 -- 172.21.15.174:0/1887776870 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c032860 con 0x7f8b440cac60 2024-09-19T05:37:21.689 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 -- 172.21.15.174:0/1887776870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440cac60 msgr2=0x7f8b44159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.689 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 --2- 172.21.15.174:0/1887776870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440cac60 0x7f8b44159250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02a300 comp rx=0 tx=0).stop 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 -- 172.21.15.174:0/1887776870 shutdown_connections 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 --2- 172.21.15.174:0/1887776870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440cac60 0x7f8b44159250 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 --2- 172.21.15.174:0/1887776870 >> v2:172.21.15.174:3300/0 conn(0x7f8b44153020 0x7f8b440c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 -- 172.21.15.174:0/1887776870 >> 172.21.15.174:0/1887776870 conn(0x7f8b440ca140 msgr2=0x7f8b440ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 -- 172.21.15.174:0/1887776870 shutdown_connections 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.686+0000 7f8b49c77640 1 -- 172.21.15.174:0/1887776870 wait complete. 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.687+0000 7f8b49c77640 1 Processor -- start 2024-09-19T05:37:21.690 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b49c77640 1 -- start start 2024-09-19T05:37:21.692 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b49c77640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440c5550 0x7f8b441e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.692 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b49c77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b440cac60 0x7f8b441e2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.692 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b49c77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b44153020 0x7f8b441e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.692 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b49c77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4406c320 con 0x7f8b44153020 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b49c77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8b440c7820 con 0x7f8b440cac60 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b49c77640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4406c4a0 con 0x7f8b440c5550 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440c5550 0x7f8b441e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b42ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b440cac60 0x7f8b441e2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440c5550 0x7f8b441e30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35436/0 (socket says 172.21.15.174:35436) 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.688+0000 7f8b437fe640 1 -- 172.21.15.174:0/324529992 learned_addr learned my addr 172.21.15.174:0/324529992 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b43fff640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b44153020 0x7f8b441e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b42ffd640 1 -- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440c5550 msgr2=0x7f8b441e30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b42ffd640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440c5550 0x7f8b441e30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b42ffd640 1 -- 172.21.15.174:0/324529992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b44153020 msgr2=0x7f8b441e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b42ffd640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b44153020 0x7f8b441e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.693 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b42ffd640 1 -- 172.21.15.174:0/324529992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b441f2010 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b437fe640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440c5550 0x7f8b441e30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b42ffd640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b440cac60 0x7f8b441e2250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c450 tx=0x7f8b2c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b3bfff640 1 -- 172.21.15.174:0/324529992 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c018070 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b3bfff640 1 -- 172.21.15.174:0/324529992 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b2c0074e0 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b3bfff640 1 -- 172.21.15.174:0/324529992 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c004a20 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b441f22b0 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b441f2870 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b3bfff640 1 -- 172.21.15.174:0/324529992 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8b2c01b070 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.689+0000 7f8b3bfff640 1 -- 172.21.15.174:0/324529992 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8b2c012980 con 0x7f8b440cac60 2024-09-19T05:37:21.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.690+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b44070d20 con 0x7f8b440cac60 2024-09-19T05:37:21.695 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.694+0000 7f8b3bfff640 1 -- 172.21.15.174:0/324529992 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8b2c01d440 con 0x7f8b440cac60 2024-09-19T05:37:21.771 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.769+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "99635d2e-a5f2-4993-8723-e9fdcc509ce2", "id": 5} v 0) -- 0x7f8b440c6770 con 0x7f8b440cac60 2024-09-19T05:37:21.776 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b3bfff640 1 -- 172.21.15.174:0/324529992 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99635d2e-a5f2-4993-8723-e9fdcc509ce2", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8b2c01d6f0 con 0x7f8b440cac60 2024-09-19T05:37:21.776 INFO:teuthology.orchestra.run.smithi174.stdout:5 2024-09-19T05:37:21.777 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b440cac60 msgr2=0x7f8b441e2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.777 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b49c77640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b440cac60 0x7f8b441e2250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c450 tx=0x7f8b2c00c910 comp rx=0 tx=0).stop 2024-09-19T05:37:21.777 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 shutdown_connections 2024-09-19T05:37:21.777 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b49c77640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b44153020 0x7f8b441e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.778 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b49c77640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b440cac60 0x7f8b441e2250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.778 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b49c77640 1 --2- 172.21.15.174:0/324529992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b440c5550 0x7f8b441e30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.778 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.775+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 >> 172.21.15.174:0/324529992 conn(0x7f8b440ca140 msgr2=0x7f8b440ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.778 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.776+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 shutdown_connections 2024-09-19T05:37:21.778 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.776+0000 7f8b49c77640 1 -- 172.21.15.174:0/324529992 wait complete. 2024-09-19T05:37:21.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 23082a6e-e556-4b08-839f-fd32d9fdf072 6 2024-09-19T05:37:21.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.886+0000 7fa36eb7f640 1 Processor -- start 2024-09-19T05:37:21.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.886+0000 7fa36eb7f640 1 -- start start 2024-09-19T05:37:21.891 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa36eb7f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3681552e0 0x7fa36806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.891 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa36eb7f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3681556c0 con 0x7fa36815af30 2024-09-19T05:37:21.891 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa36eb7f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36815b3e0 con 0x7fa36806bc10 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa36eb7f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa3680c82d0 con 0x7fa3681552e0 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa36d11c640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa36806bc10 0x7fa368165830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:43320/0 (socket says 172.21.15.174:43320) 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa36d11c640 1 -- 172.21.15.174:0/337291051 learned_addr learned my addr 172.21.15.174:0/337291051 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647223821 0 0) 0x7fa36815b3e0 con 0x7fa36806bc10 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa36c91b640 1 --2- 172.21.15.174:0/337291051 >> v2:172.21.15.103:3300/0 conn(0x7fa3681552e0 0x7fa36806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa358003520 con 0x7fa36806bc10 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1765402780 0 0) 0x7fa358003520 con 0x7fa36806bc10 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 >> v2:172.21.15.103:3300/0 conn(0x7fa3681552e0 msgr2=0x7fa36806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 --2- 172.21.15.174:0/337291051 >> v2:172.21.15.103:3300/0 conn(0x7fa3681552e0 0x7fa36806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 >> v1:172.21.15.103:6789/0 conn(0x7fa36815af30 legacy=0x7fa3680c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36815b6c0 con 0x7fa36806bc10 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fa3600019f0 con 0x7fa36806bc10 2024-09-19T05:37:21.892 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 >> v1:172.21.15.174:6789/0 conn(0x7fa36806bc10 legacy=0x7fa368165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.887+0000 7fa3677fe640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580039b0 0x7fa358003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa3677fe640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa358004800 0x7fa358004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa3677fe640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3580051c0 0x7fa35800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa35800c130 con 0x7fa3580039b0 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa35800c2e0 con 0x7fa358004800 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa35800c4e0 con 0x7fa3580051c0 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa367fff640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa358004800 0x7fa358004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa36d11c640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3580051c0 0x7fa35800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa36c91b640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580039b0 0x7fa358003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa367fff640 1 -- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3580051c0 msgr2=0x7fa35800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa367fff640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3580051c0 0x7fa35800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa367fff640 1 -- 172.21.15.174:0/337291051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580039b0 msgr2=0x7fa358003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:21.893 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa367fff640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580039b0 0x7fa358003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa367fff640 1 -- 172.21.15.174:0/337291051 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa358003520 con 0x7fa358004800 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.888+0000 7fa36d11c640 1 -- 172.21.15.174:0/337291051 reap_dead start 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa367fff640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa358004800 0x7fa358004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa354001750 tx=0x7fa358005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b97430b610860207 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354001370 con 0x7fa358004800 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3540052d0 con 0x7fa358004800 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa3677fe640 1 -- 172.21.15.174:0/337291051 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35402abe0 con 0x7fa358004800 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa36eb7f640 1 -- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa358004800 msgr2=0x7fa358004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa36eb7f640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa358004800 0x7fa358004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa354001750 tx=0x7fa358005830 comp rx=0 tx=0).stop 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa36eb7f640 1 -- 172.21.15.174:0/337291051 shutdown_connections 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa36eb7f640 1 --2- 172.21.15.174:0/337291051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa358004800 0x7fa358004c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa36eb7f640 1 -- 172.21.15.174:0/337291051 >> 172.21.15.174:0/337291051 conn(0x7fa3680ca140 msgr2=0x7fa3680ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa36eb7f640 1 -- 172.21.15.174:0/337291051 shutdown_connections 2024-09-19T05:37:21.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.889+0000 7fa36eb7f640 1 -- 172.21.15.174:0/337291051 wait complete. 2024-09-19T05:37:21.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.890+0000 7fa36eb7f640 1 Processor -- start 2024-09-19T05:37:21.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.890+0000 7fa36eb7f640 1 -- start start 2024-09-19T05:37:21.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36eb7f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa358004800 0x7fa3681f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36eb7f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3681f48b0 0x7fa3680c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36eb7f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3680c6830 0x7fa36814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:21.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36eb7f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa36806fad0 con 0x7fa3681f48b0 2024-09-19T05:37:21.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36eb7f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa36815bc80 con 0x7fa3680c6830 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36eb7f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa3680c8cd0 con 0x7fa358004800 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36c91b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa358004800 0x7fa3681f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36d11c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3680c6830 0x7fa36814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36c91b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa358004800 0x7fa3681f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35460/0 (socket says 172.21.15.174:35460) 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.891+0000 7fa36c91b640 1 -- 172.21.15.174:0/1472920116 learned_addr learned my addr 172.21.15.174:0/1472920116 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa367fff640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3681f48b0 0x7fa3680c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36d11c640 1 -- 172.21.15.174:0/1472920116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa358004800 msgr2=0x7fa3681f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36d11c640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa358004800 0x7fa3681f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36d11c640 1 -- 172.21.15.174:0/1472920116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3681f48b0 msgr2=0x7fa3680c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36d11c640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3681f48b0 0x7fa3680c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36d11c640 1 -- 172.21.15.174:0/1472920116 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680c6cb0 con 0x7fa3680c6830 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36d11c640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3680c6830 0x7fa36814ab90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa36806f6a0 tx=0x7fa360007b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa3657fa640 1 -- 172.21.15.174:0/1472920116 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36000aac0 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa3657fa640 1 -- 172.21.15.174:0/1472920116 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa360019070 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa368158960 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa3657fa640 1 -- 172.21.15.174:0/1472920116 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3600133f0 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3681579e0 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa3657fa640 1 -- 172.21.15.174:0/1472920116 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa360013590 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.892+0000 7fa3657fa640 1 -- 172.21.15.174:0/1472920116 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fa36001d3c0 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.893+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36814bc40 con 0x7fa3680c6830 2024-09-19T05:37:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.895+0000 7fa3657fa640 1 -- 172.21.15.174:0/1472920116 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa36814bc40 con 0x7fa3680c6830 2024-09-19T05:37:21.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.965+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23082a6e-e556-4b08-839f-fd32d9fdf072", "id": 6} v 0) -- 0x7fa36806fff0 con 0x7fa3680c6830 2024-09-19T05:37:21.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.970+0000 7fa3657fa640 1 -- 172.21.15.174:0/1472920116 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23082a6e-e556-4b08-839f-fd32d9fdf072", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fa3680c6cb0 con 0x7fa3680c6830 2024-09-19T05:37:21.972 INFO:teuthology.orchestra.run.smithi174.stdout:6 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3680c6830 msgr2=0x7fa36814ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3680c6830 0x7fa36814ab90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa36806f6a0 tx=0x7fa360007b10 comp rx=0 tx=0).stop 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 shutdown_connections 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3680c6830 0x7fa36814ab90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3681f48b0 0x7fa3680c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 --2- 172.21.15.174:0/1472920116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa358004800 0x7fa3681f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 >> 172.21.15.174:0/1472920116 conn(0x7fa3680ca140 msgr2=0x7fa368158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 shutdown_connections 2024-09-19T05:37:21.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:21.971+0000 7fa36eb7f640 1 -- 172.21.15.174:0/1472920116 wait complete. 2024-09-19T05:37:21.983 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new a48c97e0-83a5-41b6-8f02-49a356e9a37b 7 2024-09-19T05:37:22.081 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.079+0000 7f384d0d0640 1 Processor -- start 2024-09-19T05:37:22.081 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.079+0000 7f384d0d0640 1 -- start start 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384d0d0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38480b2fa0 0x7f3848157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384d0d0640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38480c9440 0x7f38480c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384d0d0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38480c2740 con 0x7f3848071b80 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384d0d0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f38480c2510 con 0x7f38480b2fa0 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384d0d0640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f38480c37a0 con 0x7f38480c9440 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384659c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38480c9440 0x7f38480c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384659c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38480c9440 0x7f38480c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:54130/0 (socket says 172.21.15.174:54130) 2024-09-19T05:37:22.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384659c640 1 -- 172.21.15.174:0/2863112754 learned_addr learned my addr 172.21.15.174:0/2863112754 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f3846d9d640 1 --2- 172.21.15.174:0/2863112754 >> v2:172.21.15.103:3300/0 conn(0x7f38480b2fa0 0x7f3848157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384659c640 1 -- 172.21.15.174:0/2863112754 >> v2:172.21.15.103:3300/0 conn(0x7f38480b2fa0 msgr2=0x7f3848157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384659c640 1 --2- 172.21.15.174:0/2863112754 >> v2:172.21.15.103:3300/0 conn(0x7f38480b2fa0 0x7f3848157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.080+0000 7f384659c640 1 -- 172.21.15.174:0/2863112754 >> v1:172.21.15.103:6789/0 conn(0x7f3848071b80 legacy=0x7f384806e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.081+0000 7f384659c640 1 -- 172.21.15.174:0/2863112754 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38480c2a20 con 0x7f38480c9440 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.081+0000 7f384659c640 1 --2- 172.21.15.174:0/2863112754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480c9440 0x7f38480c3c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f38480b3410 tx=0x7f383002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9a914ce90b2372 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.081+0000 7f3845d9b640 1 -- 172.21.15.174:0/2863112754 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830037070 con 0x7f38480c9440 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.081+0000 7f3845d9b640 1 -- 172.21.15.174:0/2863112754 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3830032440 con 0x7f38480c9440 2024-09-19T05:37:22.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.081+0000 7f3845d9b640 1 -- 172.21.15.174:0/2863112754 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830032810 con 0x7f38480c9440 2024-09-19T05:37:22.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 -- 172.21.15.174:0/2863112754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480c9440 msgr2=0x7f38480c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 --2- 172.21.15.174:0/2863112754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480c9440 0x7f38480c3c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f38480b3410 tx=0x7f383002a1e0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 -- 172.21.15.174:0/2863112754 shutdown_connections 2024-09-19T05:37:22.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 --2- 172.21.15.174:0/2863112754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480c9440 0x7f38480c3c30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 --2- 172.21.15.174:0/2863112754 >> v2:172.21.15.103:3300/0 conn(0x7f38480b2fa0 0x7f3848157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 -- 172.21.15.174:0/2863112754 >> 172.21.15.174:0/2863112754 conn(0x7f38480c9990 msgr2=0x7f38480c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 -- 172.21.15.174:0/2863112754 shutdown_connections 2024-09-19T05:37:22.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.082+0000 7f384d0d0640 1 -- 172.21.15.174:0/2863112754 wait complete. 2024-09-19T05:37:22.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 Processor -- start 2024-09-19T05:37:22.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 -- start start 2024-09-19T05:37:22.088 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848071b80 0x7f384806d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.088 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480b2fa0 0x7f3848153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.088 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38480c9440 0x7f3848153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.088 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f38480c3430 con 0x7f38480c9440 2024-09-19T05:37:22.088 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38480c2fe0 con 0x7f38480b2fa0 2024-09-19T05:37:22.088 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384d0d0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f384806eb10 con 0x7f3848071b80 2024-09-19T05:37:22.088 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f3846d9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848071b80 0x7f384806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f384659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480b2fa0 0x7f3848153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.084+0000 7f3846d9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848071b80 0x7f384806d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35468/0 (socket says 172.21.15.174:35468) 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f3846d9d640 1 -- 172.21.15.174:0/3077874443 learned_addr learned my addr 172.21.15.174:0/3077874443 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480b2fa0 0x7f3848153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:54132/0 (socket says 172.21.15.174:54132) 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384759e640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38480c9440 0x7f3848153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384759e640 1 -- 172.21.15.174:0/3077874443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848071b80 msgr2=0x7f384806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384759e640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848071b80 0x7f384806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384759e640 1 -- 172.21.15.174:0/3077874443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480b2fa0 msgr2=0x7f3848153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.089 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384759e640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480b2fa0 0x7f3848153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384759e640 1 -- 172.21.15.174:0/3077874443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3848157940 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384759e640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38480c9440 0x7f3848153680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384000c690 tx=0x7f384000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f383f7fe640 1 -- 172.21.15.174:0/3077874443 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840003b70 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f383f7fe640 1 -- 172.21.15.174:0/3077874443 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3840003d10 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38481f0c00 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f383f7fe640 1 -- 172.21.15.174:0/3077874443 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840005310 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38481f11c0 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f383f7fe640 1 -- 172.21.15.174:0/3077874443 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38400054b0 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.085+0000 7f383f7fe640 1 -- 172.21.15.174:0/3077874443 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f38400057a0 con 0x7f38480c9440 2024-09-19T05:37:22.090 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.086+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38480c1eb0 con 0x7f38480c9440 2024-09-19T05:37:22.091 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.088+0000 7f383f7fe640 1 -- 172.21.15.174:0/3077874443 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f384000a640 con 0x7f38480c9440 2024-09-19T05:37:22.161 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.159+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a48c97e0-83a5-41b6-8f02-49a356e9a37b", "id": 7} v 0) -- 0x7f38480c9220 con 0x7f38480c9440 2024-09-19T05:37:22.165 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.163+0000 7f383f7fe640 1 -- 172.21.15.174:0/3077874443 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a48c97e0-83a5-41b6-8f02-49a356e9a37b", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f384000a820 con 0x7f38480c9440 2024-09-19T05:37:22.165 INFO:teuthology.orchestra.run.smithi174.stdout:7 2024-09-19T05:37:22.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38480c9440 msgr2=0x7f3848153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38480c9440 0x7f3848153680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384000c690 tx=0x7f384000cb50 comp rx=0 tx=0).stop 2024-09-19T05:37:22.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 shutdown_connections 2024-09-19T05:37:22.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38480c9440 0x7f3848153680 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38480b2fa0 0x7f3848153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 --2- 172.21.15.174:0/3077874443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848071b80 0x7f384806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 >> 172.21.15.174:0/3077874443 conn(0x7f38480c9990 msgr2=0x7f38480c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 shutdown_connections 2024-09-19T05:37:22.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-19T05:37:22.164+0000 7f384d0d0640 1 -- 172.21.15.174:0/3077874443 wait complete. 2024-09-19T05:37:22.177 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T05:37:22.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T05:37:22.180 INFO:tasks.ceph.osd.0:Started 2024-09-19T05:37:22.180 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T05:37:22.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T05:37:22.182 INFO:tasks.ceph.osd.1:Started 2024-09-19T05:37:22.183 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T05:37:22.183 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T05:37:22.185 INFO:tasks.ceph.osd.2:Started 2024-09-19T05:37:22.185 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T05:37:22.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T05:37:22.187 INFO:tasks.ceph.osd.3:Started 2024-09-19T05:37:22.187 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T05:37:22.187 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T05:37:22.190 INFO:tasks.ceph.osd.4:Started 2024-09-19T05:37:22.190 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T05:37:22.190 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T05:37:22.192 INFO:tasks.ceph.osd.5:Started 2024-09-19T05:37:22.192 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T05:37:22.192 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T05:37:22.197 INFO:tasks.ceph.osd.6:Started 2024-09-19T05:37:22.197 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T05:37:22.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T05:37:22.199 INFO:tasks.ceph.osd.7:Started 2024-09-19T05:37:22.199 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:22.205 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:22.204+0000 7f2b98927040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:37:22.283 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:22.281+0000 7f2b98927040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:37:22.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.318+0000 7f7c60642640 1 Processor -- start 2024-09-19T05:37:22.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.318+0000 7f7c60642640 1 -- start start 2024-09-19T05:37:22.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c60642640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c5815af30 0x7f7c580c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c60642640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c58070700 0x7f7c580c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c60642640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c581556c0 con 0x7f7c581552e0 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c60642640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7c580c82d0 con 0x7f7c5815af30 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c60642640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5815b3e0 con 0x7f7c58070700 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5e3de640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7c581552e0 0x7f7c5806fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60630/0 (socket says 172.21.15.103:60630) 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5e3de640 1 -- 172.21.15.103:0/2376287860 learned_addr learned my addr 172.21.15.103:0/2376287860 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5dbdd640 1 --2- 172.21.15.103:0/2376287860 >> v2:172.21.15.103:3300/0 conn(0x7f7c5815af30 0x7f7c580c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5ebdf640 1 --2- 172.21.15.103:0/2376287860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c58070700 0x7f7c580c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5dbdd640 1 -- 172.21.15.103:0/2376287860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c58070700 msgr2=0x7f7c580c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5dbdd640 1 --2- 172.21.15.103:0/2376287860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c58070700 0x7f7c580c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5dbdd640 1 -- 172.21.15.103:0/2376287860 >> v1:172.21.15.103:6789/0 conn(0x7f7c581552e0 legacy=0x7f7c5806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5d3dc640 1 -- 172.21.15.103:0/2376287860 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702640750 0 0) 0x7f7c54001110 con 0x7f7c581552e0 2024-09-19T05:37:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.319+0000 7f7c5dbdd640 1 -- 172.21.15.103:0/2376287860 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5815b6c0 con 0x7f7c5815af30 2024-09-19T05:37:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.320+0000 7f7c5dbdd640 1 --2- 172.21.15.103:0/2376287860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5815af30 0x7f7c580c9290 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7c480097a0 tx=0x7f7c4802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3947b528c06f16e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.320+0000 7f7c5d3dc640 1 -- 172.21.15.103:0/2376287860 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48037070 con 0x7f7c5815af30 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.320+0000 7f7c5d3dc640 1 -- 172.21.15.103:0/2376287860 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c48032440 con 0x7f7c5815af30 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.320+0000 7f7c5d3dc640 1 -- 172.21.15.103:0/2376287860 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48032810 con 0x7f7c5815af30 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 -- 172.21.15.103:0/2376287860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5815af30 msgr2=0x7f7c580c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 --2- 172.21.15.103:0/2376287860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5815af30 0x7f7c580c9290 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7c480097a0 tx=0x7f7c4802a180 comp rx=0 tx=0).stop 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 -- 172.21.15.103:0/2376287860 shutdown_connections 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 --2- 172.21.15.103:0/2376287860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c58070700 0x7f7c580c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 --2- 172.21.15.103:0/2376287860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5815af30 0x7f7c580c9290 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 -- 172.21.15.103:0/2376287860 >> 172.21.15.103:0/2376287860 conn(0x7f7c580ca140 msgr2=0x7f7c580ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 -- 172.21.15.103:0/2376287860 shutdown_connections 2024-09-19T05:37:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.321+0000 7f7c60642640 1 -- 172.21.15.103:0/2376287860 wait complete. 2024-09-19T05:37:22.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.322+0000 7f7c60642640 1 Processor -- start 2024-09-19T05:37:22.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.322+0000 7f7c60642640 1 -- start start 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c60642640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c58070700 0x7f7c58150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c60642640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c581552e0 0x7f7c58156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c60642640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5815af30 0x7f7c58157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c58070700 0x7f7c58150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c60642640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5806fad0 con 0x7f7c58070700 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c58070700 0x7f7c58150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40318/0 (socket says 172.21.15.103:40318) 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 -- 172.21.15.103:0/1084418047 learned_addr learned my addr 172.21.15.103:0/1084418047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5815bc80 con 0x7f7c581552e0 2024-09-19T05:37:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7c580c9d10 con 0x7f7c5815af30 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5dbdd640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c581552e0 0x7f7c58156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5ebdf640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5815af30 0x7f7c58157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 -- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5815af30 msgr2=0x7f7c58157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5815af30 0x7f7c58157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 -- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c581552e0 msgr2=0x7f7c58156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c581552e0 0x7f7c58156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.323+0000 7f7c5e3de640 1 -- 172.21.15.103:0/1084418047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c580c6450 con 0x7f7c58070700 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c5e3de640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c58070700 0x7f7c58150970 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c7b0 tx=0x7f7c5400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c4effd640 1 -- 172.21.15.103:0/1084418047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54018070 con 0x7f7c58070700 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c4effd640 1 -- 172.21.15.103:0/1084418047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c540072d0 con 0x7f7c58070700 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c58155a60 con 0x7f7c58070700 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c4effd640 1 -- 172.21.15.103:0/1084418047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c540047e0 con 0x7f7c58070700 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c58156020 con 0x7f7c58070700 2024-09-19T05:37:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c4effd640 1 -- 172.21.15.103:0/1084418047 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c5401b070 con 0x7f7c58070700 2024-09-19T05:37:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.324+0000 7f7c4effd640 1 -- 172.21.15.103:0/1084418047 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7c54012ad0 con 0x7f7c58070700 2024-09-19T05:37:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.325+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c580c9490 con 0x7f7c58070700 2024-09-19T05:37:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.327+0000 7f7c4effd640 1 -- 172.21.15.103:0/1084418047 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7c581556c0 con 0x7f7c58070700 2024-09-19T05:37:22.374 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:22.372+0000 7f30a2636040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:37:22.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.385+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c580c4750 con 0x7f7c58070700 2024-09-19T05:37:22.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.386+0000 7f7c4effd640 1 -- 172.21.15.103:0/1084418047 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7c5400a9b0 con 0x7f7c58070700 2024-09-19T05:37:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":10,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:22.160942+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:22.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.386+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c58070700 msgr2=0x7f7c58150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:22.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.386+0000 7f7c60642640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c58070700 0x7f7c58150970 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c7b0 tx=0x7f7c5400cc70 comp rx=0 tx=0).stop 2024-09-19T05:37:22.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.387+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 shutdown_connections 2024-09-19T05:37:22.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.387+0000 7f7c60642640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5815af30 0x7f7c58157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.387+0000 7f7c60642640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c581552e0 0x7f7c58156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.387+0000 7f7c60642640 1 --2- 172.21.15.103:0/1084418047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c58070700 0x7f7c58150970 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:22.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.387+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 >> 172.21.15.103:0/1084418047 conn(0x7f7c580ca140 msgr2=0x7f7c5806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:22.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.387+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 shutdown_connections 2024-09-19T05:37:22.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:22.387+0000 7f7c60642640 1 -- 172.21.15.103:0/1084418047 wait complete. 2024-09-19T05:37:22.405 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T05:37:22.405 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T05:37:22.426 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:22.424+0000 7f30a2636040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:37:22.663 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:22.662+0000 7f2b98927040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:37:22.747 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:22.746+0000 7f2b98927040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:37:22.793 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:22.791+0000 7f30a2636040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:37:22.855 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:22.853+0000 7f2b98927040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:37:22.881 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:22.879+0000 7f30a2636040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:37:22.901 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:22.899+0000 7f2b98927040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:37:22.989 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:22.987+0000 7f30a2636040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:37:23.012 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.010+0000 7f2b98927040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:37:23.034 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.033+0000 7f30a2636040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:37:23.064 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.063+0000 7f2b98927040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:37:23.111 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.109+0000 7f2b98927040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:37:23.149 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.147+0000 7f30a2636040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:37:23.191 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-09-19T05:37:23.189+0000 7f3e9d60c640 -1 Falling back to public interface 2024-09-19T05:37:23.204 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.202+0000 7f30a2636040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:37:23.211 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:23.224 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.223+0000 7f2b98927040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:37:23.249 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.247+0000 7f30a2636040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:37:23.277 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.276+0000 7f2b98927040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:37:23.303 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.301+0000 7f50b558d640 1 Processor -- start 2024-09-19T05:37:23.303 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.301+0000 7f50b558d640 1 -- start start 2024-09-19T05:37:23.304 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50b558d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b00d0e90 0x7f50b006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.304 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50b558d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50b015b000 con 0x7f50b01552c0 2024-09-19T05:37:23.304 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50b558d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50b015b2e0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50b558d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f50b015b5c0 con 0x7f50b00d0e90 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50ae7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50b01552c0 0x7f50b006bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60640/0 (socket says 172.21.15.103:60640) 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50ae7fc640 1 -- 172.21.15.103:0/2576921951 learned_addr learned my addr 172.21.15.103:0/2576921951 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50af7fe640 1 --2- 172.21.15.103:0/2576921951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b00d0e90 0x7f50b006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.302+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726142570 0 0) 0x7f50b015b000 con 0x7f50b01552c0 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f509c003520 con 0x7f50b01552c0 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669227983 0 0) 0x7f50b015b2e0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50b015b000 con 0x7f50b00d0ab0 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50af7fe640 1 -- 172.21.15.103:0/2576921951 >> v1:172.21.15.174:6789/0 conn(0x7f50b00d0ab0 legacy=0x7f50b0154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1370422864 0 0) 0x7f509c003520 con 0x7f50b01552c0 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50af7fe640 1 -- 172.21.15.103:0/2576921951 >> v1:172.21.15.103:6789/0 conn(0x7f50b01552c0 legacy=0x7f50b006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.305 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50af7fe640 1 -- 172.21.15.103:0/2576921951 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b015b8a0 con 0x7f50b00d0e90 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.303+0000 7f50af7fe640 1 --2- 172.21.15.103:0/2576921951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b00d0e90 0x7f50b006e260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009dc0 tx=0x7f50a802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2a213a312e9e122 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098001690 con 0x7f50b00d0e90 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a802ae50 con 0x7f50b00d0e90 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50adffb640 1 -- 172.21.15.103:0/2576921951 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8007740 con 0x7f50b00d0e90 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50b558d640 1 -- 172.21.15.103:0/2576921951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b00d0e90 msgr2=0x7f50b006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50b558d640 1 --2- 172.21.15.103:0/2576921951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b00d0e90 0x7f50b006e260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009dc0 tx=0x7f50a802a6f0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50b558d640 1 -- 172.21.15.103:0/2576921951 shutdown_connections 2024-09-19T05:37:23.307 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50b558d640 1 --2- 172.21.15.103:0/2576921951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b00d0e90 0x7f50b006e260 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.308 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50b558d640 1 -- 172.21.15.103:0/2576921951 >> 172.21.15.103:0/2576921951 conn(0x7f50b0073970 msgr2=0x7f50b006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:23.308 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50b558d640 1 -- 172.21.15.103:0/2576921951 shutdown_connections 2024-09-19T05:37:23.308 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.304+0000 7f50b558d640 1 -- 172.21.15.103:0/2576921951 wait complete. 2024-09-19T05:37:23.310 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 Processor -- start 2024-09-19T05:37:23.310 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 -- start start 2024-09-19T05:37:23.310 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b00d0ab0 0x7f50b0148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.310 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50b00d0e90 0x7f50b00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.310 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b01552c0 0x7f50b00b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50b00cb2b0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f50b00cd0e0 con 0x7f50b00d0e90 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50b558d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f50b006c420 con 0x7f50b01552c0 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b00d0ab0 0x7f50b0148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.306+0000 7f50aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b00d0ab0 0x7f50b0148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40322/0 (socket says 172.21.15.103:40322) 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50aeffd640 1 -- 172.21.15.103:0/1552048278 learned_addr learned my addr 172.21.15.103:0/1552048278 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50ae7fc640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50b00d0e90 0x7f50b00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50af7fe640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b01552c0 0x7f50b00b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50aeffd640 1 -- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b01552c0 msgr2=0x7f50b00b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50aeffd640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b01552c0 0x7f50b00b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50aeffd640 1 -- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50b00d0e90 msgr2=0x7f50b00b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50aeffd640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50b00d0e90 0x7f50b00b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50aeffd640 1 -- 172.21.15.103:0/1552048278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b0148e50 con 0x7f50b00d0ab0 2024-09-19T05:37:23.311 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50aeffd640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b00d0ab0 0x7f50b0148910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50a000c490 tx=0x7f50a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50a77fe640 1 -- 172.21.15.103:0/1552048278 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a00052d0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50a77fe640 1 -- 172.21.15.103:0/1552048278 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a0005470 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b00cef30 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50a77fe640 1 -- 172.21.15.103:0/1552048278 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a0012850 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b01f1340 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50a77fe640 1 -- 172.21.15.103:0/1552048278 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f50a00129f0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.307+0000 7f50a77fe640 1 -- 172.21.15.103:0/1552048278 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f50a001bce0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.308+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b00cbef0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.312 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.310+0000 7f50a77fe640 1 -- 172.21.15.103:0/1552048278 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f50a001b5d0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.345 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.344+0000 7f2b98927040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:37:23.359 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.358+0000 7f30a2636040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:37:23.390 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.389+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50b015f200 con 0x7f50b00d0ab0 2024-09-19T05:37:23.390 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.389+0000 7f50a77fe640 1 -- 172.21.15.103:0/1552048278 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f50a001b7b0 con 0x7f50b00d0ab0 2024-09-19T05:37:23.391 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-19T05:37:23.391 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":10,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:22.160942+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b00d0ab0 msgr2=0x7f50b0148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b00d0ab0 0x7f50b0148910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50a000c490 tx=0x7f50a000c950 comp rx=0 tx=0).stop 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 shutdown_connections 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50b01552c0 0x7f50b00b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50b00d0e90 0x7f50b00b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 --2- 172.21.15.103:0/1552048278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b00d0ab0 0x7f50b0148910 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 >> 172.21.15.103:0/1552048278 conn(0x7f50b0073970 msgr2=0x7f50b00c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 shutdown_connections 2024-09-19T05:37:23.392 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:23.390+0000 7f50b558d640 1 -- 172.21.15.103:0/1552048278 wait complete. 2024-09-19T05:37:23.401 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T05:37:23.410 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.409+0000 7f30a2636040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:37:23.418 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.417+0000 7f2b98927040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:37:23.462 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.460+0000 7f30a2636040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:37:23.463 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.462+0000 7f2b98927040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:37:23.506 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:23.505+0000 7f2b98927040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:37:23.530 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.528+0000 7f30a2636040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:37:23.573 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.571+0000 7f30a2636040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:37:23.616 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:23.615+0000 7f30a2636040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:37:23.659 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-19T05:37:23.657+0000 7fbf2f22c640 -1 Falling back to public interface 2024-09-19T05:37:23.887 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-19T05:37:23.885+0000 7fe84703e640 -1 Falling back to public interface 2024-09-19T05:37:23.903 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-19T05:37:23.901+0000 7fd158a1e640 -1 Falling back to public interface 2024-09-19T05:37:23.908 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-09-19T05:37:23.906+0000 7f6a1d758640 -1 Falling back to public interface 2024-09-19T05:37:23.916 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-09-19T05:37:23.914+0000 7f661cf2c640 -1 Falling back to public interface 2024-09-19T05:37:24.146 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-19T05:37:24.144+0000 7ffa33e0f640 -1 Falling back to public interface 2024-09-19T05:37:24.167 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:24.166+0000 7f2b98927040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:37:24.184 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-09-19T05:37:24.182+0000 7f475ca0b640 -1 Falling back to public interface 2024-09-19T05:37:24.280 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-09-19T05:37:24.279+0000 7f30a2636040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:37:25.179 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:25.178+0000 7f2b388b7640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T05:37:25.180 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-19T05:37:25.178+0000 7f2b388b7640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T05:37:27.446 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-09-19T05:37:27.444+0000 7f6a1d758640 -1 osd.5 0 log_to_monitors true 2024-09-19T05:37:27.460 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-19T05:37:27.459+0000 7fbf2f22c640 -1 osd.0 0 log_to_monitors true 2024-09-19T05:37:27.502 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-09-19T05:37:27.500+0000 7f3e9d60c640 -1 osd.7 0 log_to_monitors true 2024-09-19T05:37:27.666 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-19T05:37:27.665+0000 7fe84703e640 -1 osd.1 0 log_to_monitors true 2024-09-19T05:37:27.891 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-19T05:37:27.890+0000 7ffa33e0f640 -1 osd.2 0 log_to_monitors true 2024-09-19T05:37:28.012 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-09-19T05:37:28.010+0000 7f475ca0b640 -1 osd.4 0 log_to_monitors true 2024-09-19T05:37:28.018 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-09-19T05:37:28.017+0000 7f661cf2c640 -1 osd.6 0 log_to_monitors true 2024-09-19T05:37:28.229 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-19T05:37:28.228+0000 7fd158a1e640 -1 osd.3 0 log_to_monitors true 2024-09-19T05:37:30.018 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-19T05:37:30.017+0000 7fe842fcd640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T05:37:30.030 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-19T05:37:30.029+0000 7fe83aded640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:30.067 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-19T05:37:30.064+0000 7fbf2b1bb640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T05:37:30.082 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-19T05:37:30.081+0000 7fbf22fdb640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:30.145 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-19T05:37:30.144+0000 7ffa2f71e640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T05:37:30.160 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-19T05:37:30.159+0000 7ffa2753e640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:30.169 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-09-19T05:37:30.167+0000 7f6a196e7640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T05:37:30.194 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-09-19T05:37:30.192+0000 7f6a11507640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:30.202 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-09-19T05:37:30.200+0000 7f3e98e86640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T05:37:30.207 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:30.222 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-09-19T05:37:30.220+0000 7f475844b640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T05:37:30.227 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-09-19T05:37:30.226+0000 7f3e90ca6640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:30.249 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-09-19T05:37:30.247+0000 7f475026b640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:30.313 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.311+0000 7f30ea3e8640 1 Processor -- start 2024-09-19T05:37:30.313 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.311+0000 7f30ea3e8640 1 -- start start 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30ea3e8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30e4072c70 0x7f30e40739c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30ea3e8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e40c49c0 con 0x7f30e4072890 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30ea3e8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e4157e00 con 0x7f30e4152010 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30ea3e8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f30e41580e0 con 0x7f30e4072c70 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30e8985640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30e4072c70 0x7f30e40739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30e3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f30e4072890 0x7f30e4151900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60648/0 (socket says 172.21.15.103:60648) 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30e3fff640 1 -- 172.21.15.103:0/2668613171 learned_addr learned my addr 172.21.15.103:0/2668613171 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30e8985640 1 -- 172.21.15.103:0/2668613171 >> v1:172.21.15.174:6789/0 conn(0x7f30e4152010 legacy=0x7f30e40732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.314 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30e8985640 1 -- 172.21.15.103:0/2668613171 >> v1:172.21.15.103:6789/0 conn(0x7f30e4072890 legacy=0x7f30e4151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.315 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.312+0000 7f30e2ffd640 1 -- 172.21.15.103:0/2668613171 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419230391 0 0) 0x7f30e4157e00 con 0x7f30e4152010 2024-09-19T05:37:30.315 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.313+0000 7f30e8985640 1 -- 172.21.15.103:0/2668613171 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e41583c0 con 0x7f30e4072c70 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.313+0000 7f30e8985640 1 --2- 172.21.15.103:0/2668613171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4072c70 0x7f30e40739c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009d90 tx=0x7f30dc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3823d2028f815c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.313+0000 7f30e2ffd640 1 -- 172.21.15.103:0/2668613171 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc007740 con 0x7f30e4072c70 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30e2ffd640 1 -- 172.21.15.103:0/2668613171 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30dc0078e0 con 0x7f30e4072c70 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30e2ffd640 1 -- 172.21.15.103:0/2668613171 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc007cb0 con 0x7f30e4072c70 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30ea3e8640 1 -- 172.21.15.103:0/2668613171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4072c70 msgr2=0x7f30e40739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/2668613171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4072c70 0x7f30e40739c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009d90 tx=0x7f30dc02a5f0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30ea3e8640 1 -- 172.21.15.103:0/2668613171 shutdown_connections 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/2668613171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4072c70 0x7f30e40739c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.316 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30ea3e8640 1 -- 172.21.15.103:0/2668613171 >> 172.21.15.103:0/2668613171 conn(0x7f30e40cd8a0 msgr2=0x7f30e40cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:30.317 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30ea3e8640 1 -- 172.21.15.103:0/2668613171 shutdown_connections 2024-09-19T05:37:30.317 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.314+0000 7f30ea3e8640 1 -- 172.21.15.103:0/2668613171 wait complete. 2024-09-19T05:37:30.317 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.316+0000 7f30ea3e8640 1 Processor -- start 2024-09-19T05:37:30.317 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.316+0000 7f30ea3e8640 1 -- start start 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30ea3e8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e4072890 0x7f30e40cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30ea3e8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30e4072c70 0x7f30e41eca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30ea3e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4152010 0x7f30e41ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30ea3e8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f30e40c4450 con 0x7f30e4152010 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30ea3e8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4157ad0 con 0x7f30e4072890 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30ea3e8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f30e40c45d0 con 0x7f30e4072c70 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e8985640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4152010 0x7f30e41ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e4072890 0x7f30e40cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.320 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e4072890 0x7f30e40cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:42592/0 (socket says 172.21.15.103:42592) 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e37fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30e4072c70 0x7f30e41eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e8985640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4152010 0x7f30e41ecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40452/0 (socket says 172.21.15.103:40452) 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e3fff640 1 -- 172.21.15.103:0/1236318700 learned_addr learned my addr 172.21.15.103:0/1236318700 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e8985640 1 -- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30e4072c70 msgr2=0x7f30e41eca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e8985640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30e4072c70 0x7f30e41eca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e8985640 1 -- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e4072890 msgr2=0x7f30e40cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e8985640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e4072890 0x7f30e40cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.317+0000 7f30e8985640 1 -- 172.21.15.103:0/1236318700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e41f0820 con 0x7f30e4152010 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30e3fff640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e4072890 0x7f30e40cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30e37fe640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30e4072c70 0x7f30e41eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30e8985640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4152010 0x7f30e41ecf70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30dc031000 tx=0x7f30dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30e0ff9640 1 -- 172.21.15.103:0/1236318700 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc040070 con 0x7f30e4152010 2024-09-19T05:37:30.321 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30e0ff9640 1 -- 172.21.15.103:0/1236318700 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30dc031bc0 con 0x7f30e4152010 2024-09-19T05:37:30.322 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e4150f60 con 0x7f30e4152010 2024-09-19T05:37:30.322 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30e0ff9640 1 -- 172.21.15.103:0/1236318700 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc003990 con 0x7f30e4152010 2024-09-19T05:37:30.322 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.318+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41f0540 con 0x7f30e4152010 2024-09-19T05:37:30.323 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.319+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e41f0330 con 0x7f30e4152010 2024-09-19T05:37:30.323 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.320+0000 7f30e0ff9640 1 -- 172.21.15.103:0/1236318700 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f30dc039040 con 0x7f30e4152010 2024-09-19T05:37:30.323 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.320+0000 7f30e0ff9640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f30d006c220 0x7f30d006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:30.323 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.320+0000 7f30e0ff9640 1 -- 172.21.15.103:0/1236318700 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3071+0+0 (secure 0 0 0) 0x7f30dc0abb20 con 0x7f30e4152010 2024-09-19T05:37:30.323 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.320+0000 7f30e3fff640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f30d006c220 0x7f30d006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:30.323 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.321+0000 7f30e3fff640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f30d006c220 0x7f30d006e6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f30d4004830 tx=0x7f30d4007f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:30.326 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.325+0000 7f30e0ff9640 1 -- 172.21.15.103:0/1236318700 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f30dc07a770 con 0x7f30e4152010 2024-09-19T05:37:30.550 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.549+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30e4070750 con 0x7f30e4152010 2024-09-19T05:37:30.551 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.549+0000 7f30e0ff9640 1 -- 172.21.15.103:0/1236318700 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8539 (secure 0 0 0) 0x7f30dc07ea70 con 0x7f30e4152010 2024-09-19T05:37:30.551 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-19T05:37:30.551 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":13,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:30.184082+0000","last_up_change":"2024-09-19T05:37:30.184082+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f30d006c220 msgr2=0x7f30d006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f30d006c220 0x7f30d006e6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f30d4004830 tx=0x7f30d4007f10 comp rx=0 tx=0).stop 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4152010 msgr2=0x7f30e41ecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4152010 0x7f30e41ecf70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30dc031000 tx=0x7f30dc004a40 comp rx=0 tx=0).stop 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 shutdown_connections 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f30d006c220 0x7f30d006e6e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30e4152010 0x7f30e41ecf70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.554 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30e4072c70 0x7f30e41eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.555 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 --2- 172.21.15.103:0/1236318700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30e4072890 0x7f30e40cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:30.555 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 >> 172.21.15.103:0/1236318700 conn(0x7f30e40cd8a0 msgr2=0x7f30e414b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:30.555 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 shutdown_connections 2024-09-19T05:37:30.555 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:30.552+0000 7f30ea3e8640 1 -- 172.21.15.103:0/1236318700 wait complete. 2024-09-19T05:37:30.564 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-09-19T05:37:30.598 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-09-19T05:37:30.596+0000 7f6618ebb640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T05:37:30.611 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-09-19T05:37:30.610+0000 7f6610cdb640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:30.776 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-19T05:37:30.775+0000 7fd154c72640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T05:37:30.786 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-19T05:37:30.785+0000 7fd14c27e640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:37:37.371 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:37.471 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 Processor -- start 2024-09-19T05:37:37.471 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 -- start start 2024-09-19T05:37:37.473 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4d8070540 0x7fd4d815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.473 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4d8070920 0x7fd4d806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.473 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d8155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.473 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd4d815bf30 con 0x7fd4d8070920 2024-09-19T05:37:37.473 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fd4d80733e0 con 0x7fd4d8070540 2024-09-19T05:37:37.473 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.469+0000 7fd4ddbc6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d806c150 con 0x7fd4d8154e30 2024-09-19T05:37:37.473 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4d8070920 0x7fd4d806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4d8070920 0x7fd4d806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44298/0 (socket says 172.21.15.103:44298) 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3067333032 learned_addr learned my addr 172.21.15.103:0/3067333032 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d77fe640 1 --2- 172.21.15.103:0/3067333032 >> v2:172.21.15.174:3300/0 conn(0x7fd4d8070540 0x7fd4d815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3067333032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 msgr2=0x7fd4d8155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d7fff640 1 --2- 172.21.15.103:0/3067333032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/3067333032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d8155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3067333032 >> v2:172.21.15.174:3300/0 conn(0x7fd4d8070540 msgr2=0x7fd4d815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/3067333032 >> v2:172.21.15.174:3300/0 conn(0x7fd4d8070540 0x7fd4d815b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.470+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3067333032 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d80c9fa0 con 0x7fd4d8070920 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/3067333032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d806bc10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80c97b0 tx=0x7fd4cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd66003d31a2d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4d67fc640 1 -- 172.21.15.103:0/3067333032 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc037070 con 0x7fd4d8070920 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4d67fc640 1 -- 172.21.15.103:0/3067333032 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc032440 con 0x7fd4d8070920 2024-09-19T05:37:37.474 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4d67fc640 1 -- 172.21.15.103:0/3067333032 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc032810 con 0x7fd4d8070920 2024-09-19T05:37:37.475 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3067333032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 msgr2=0x7fd4d806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3067333032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d806bc10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80c97b0 tx=0x7fd4cc02a270 comp rx=0 tx=0).stop 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3067333032 shutdown_connections 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3067333032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d8155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3067333032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d806bc10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3067333032 >> v2:172.21.15.174:3300/0 conn(0x7fd4d8070540 0x7fd4d815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3067333032 >> 172.21.15.103:0/3067333032 conn(0x7fd4d80cdb50 msgr2=0x7fd4d80cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3067333032 shutdown_connections 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.471+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3067333032 wait complete. 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.473+0000 7fd4ddbc6640 1 Processor -- start 2024-09-19T05:37:37.476 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.473+0000 7fd4ddbc6640 1 -- start start 2024-09-19T05:37:37.479 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.473+0000 7fd4ddbc6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8070540 0x7fd4d81f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.479 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.473+0000 7fd4ddbc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d81f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.479 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.473+0000 7fd4ddbc6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d80cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.479 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.473+0000 7fd4ddbc6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8072d90 con 0x7fd4d8070920 2024-09-19T05:37:37.479 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.473+0000 7fd4ddbc6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8072ab0 con 0x7fd4d8070540 2024-09-19T05:37:37.479 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4ddbc6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d8073070 con 0x7fd4d8154e30 2024-09-19T05:37:37.479 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d81f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d81f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44302/0 (socket says 172.21.15.103:44302) 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8070540 0x7fd4d81f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3558406607 learned_addr learned my addr 172.21.15.103:0/3558406607 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d7fff640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d80cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3558406607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 msgr2=0x7fd4d80cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d80cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3558406607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8070540 msgr2=0x7fd4d81f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8070540 0x7fd4d81f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/3558406607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d8155a80 con 0x7fd4d8070920 2024-09-19T05:37:37.480 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d81f5010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc000c00 tx=0x7fd4cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4bffff640 1 -- 172.21.15.103:0/3558406607 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc037040 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4bffff640 1 -- 172.21.15.103:0/3558406607 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc042070 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4bffff640 1 -- 172.21.15.103:0/3558406607 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc030bb0 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d8155d60 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.474+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d8158680 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.475+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d815b9f0 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.476+0000 7fd4bffff640 1 -- 172.21.15.103:0/3558406607 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4cc047460 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.476+0000 7fd4bffff640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4c406c2b0 0x7fd4c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.476+0000 7fd4bffff640 1 -- 172.21.15.103:0/3558406607 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd4cc0abbd0 con 0x7fd4d8070920 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.476+0000 7fd4d77fe640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4c406c2b0 0x7fd4c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.481 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.477+0000 7fd4d77fe640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4c406c2b0 0x7fd4c406e770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800aa20 tx=0x7fd4c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.483 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.481+0000 7fd4bffff640 1 -- 172.21.15.103:0/3558406607 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd4cc07a040 con 0x7fd4d8070920 2024-09-19T05:37:37.652 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.649+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4d80c7c00 con 0x7fd4d8070920 2024-09-19T05:37:37.652 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.650+0000 7fd4bffff640 1 -- 172.21.15.103:0/3558406607 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12968 (secure 0 0 0) 0x7fd4cc07e340 con 0x7fd4d8070920 2024-09-19T05:37:37.653 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-19T05:37:37.653 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":17,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:34.223479+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4c406c2b0 msgr2=0x7fd4c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4c406c2b0 0x7fd4c406e770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800aa20 tx=0x7fd4c8008040 comp rx=0 tx=0).stop 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 msgr2=0x7fd4d81f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d81f5010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc000c00 tx=0x7fd4cc0046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 shutdown_connections 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4c406c2b0 0x7fd4c406e770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d8154e30 0x7fd4d80cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d8070920 0x7fd4d81f5010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 --2- 172.21.15.103:0/3558406607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8070540 0x7fd4d81f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 >> 172.21.15.103:0/3558406607 conn(0x7fd4d80cdb50 msgr2=0x7fd4d8154230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.655 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 shutdown_connections 2024-09-19T05:37:37.656 INFO:teuthology.misc.health.smithi103.stderr:2024-09-19T05:37:37.652+0000 7fd4ddbc6640 1 -- 172.21.15.103:0/3558406607 wait complete. 2024-09-19T05:37:37.664 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T05:37:37.664 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T05:37:37.665 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T05:37:37.665 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T05:37:37.667 INFO:tasks.ceph.mds.a:Started 2024-09-19T05:37:37.667 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T05:37:37.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T05:37:37.669 INFO:tasks.ceph.mds.c:Started 2024-09-19T05:37:37.669 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-19T05:37:37.669 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-19T05:37:37.671 INFO:tasks.ceph.mds.e:Started 2024-09-19T05:37:37.671 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T05:37:37.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T05:37:37.674 INFO:tasks.ceph.mds.b:Started 2024-09-19T05:37:37.674 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T05:37:37.674 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T05:37:37.677 INFO:tasks.ceph.mds.d:Started 2024-09-19T05:37:37.677 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-19T05:37:37.677 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-19T05:37:37.680 INFO:tasks.ceph.mds.f:Started 2024-09-19T05:37:37.680 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-19T05:37:37.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:37.745 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-19T05:37:37.745 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-19T05:37:37.748 INFO:tasks.ceph.mds.e.smithi103.stdout:starting mds.e at 2024-09-19T05:37:37.761 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-09-19T05:37:37.761 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-09-19T05:37:37.765 INFO:tasks.ceph.mds.f.smithi174.stdout:starting mds.f at 2024-09-19T05:37:37.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.785+0000 7f5b3430a640 1 Processor -- start 2024-09-19T05:37:37.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.785+0000 7f5b3430a640 1 -- start start 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b3430a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b3430a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b2c0c5950 0x7f5b2c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b3430a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2c0cbed0 con 0x7f5b2c155040 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b3430a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2c15bd70 con 0x7f5b2c0c5950 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b3430a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2c0cbbf0 con 0x7f5b2c0b3540 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b328a7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b2c0c5950 0x7f5b2c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b328a7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b2c0c5950 0x7f5b2c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44346/0 (socket says 172.21.15.103:44346) 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b320a6640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5b2c155040 0x7f5b2c15e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56680/0 (socket says 172.21.15.103:56680) 2024-09-19T05:37:37.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b328a7640 1 -- 172.21.15.103:0/1688985408 learned_addr learned my addr 172.21.15.103:0/1688985408 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:37.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b318a5640 1 --2- 172.21.15.103:0/1688985408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b328a7640 1 -- 172.21.15.103:0/1688985408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 msgr2=0x7f5b2c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:37.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b328a7640 1 --2- 172.21.15.103:0/1688985408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b328a7640 1 -- 172.21.15.103:0/1688985408 >> v1:172.21.15.103:6789/0 conn(0x7f5b2c155040 legacy=0x7f5b2c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b310a4640 1 -- 172.21.15.103:0/1688985408 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2233437385 0 0) 0x7f5b2c0cbed0 con 0x7f5b2c155040 2024-09-19T05:37:37.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.786+0000 7f5b328a7640 1 -- 172.21.15.103:0/1688985408 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c15afb0 con 0x7f5b2c0c5950 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.787+0000 7f5b328a7640 1 --2- 172.21.15.103:0/1688985408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c0cc2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009e50 tx=0x7f5b2402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7d284e9dd195e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.787+0000 7f5b310a4640 1 -- 172.21.15.103:0/1688985408 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24036070 con 0x7f5b2c0c5950 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.787+0000 7f5b310a4640 1 -- 172.21.15.103:0/1688985408 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b24031600 con 0x7f5b2c0c5950 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.787+0000 7f5b310a4640 1 -- 172.21.15.103:0/1688985408 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b240319d0 con 0x7f5b2c0c5950 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 -- 172.21.15.103:0/1688985408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c0c5950 msgr2=0x7f5b2c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 --2- 172.21.15.103:0/1688985408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c0cc2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009e50 tx=0x7f5b2402a7a0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 -- 172.21.15.103:0/1688985408 shutdown_connections 2024-09-19T05:37:37.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 --2- 172.21.15.103:0/1688985408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c0cc2c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 --2- 172.21.15.103:0/1688985408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 -- 172.21.15.103:0/1688985408 >> 172.21.15.103:0/1688985408 conn(0x7f5b2c073340 msgr2=0x7f5b2c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 -- 172.21.15.103:0/1688985408 shutdown_connections 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.788+0000 7f5b3430a640 1 -- 172.21.15.103:0/1688985408 wait complete. 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.789+0000 7f5b3430a640 1 Processor -- start 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.789+0000 7f5b3430a640 1 -- start start 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.789+0000 7f5b3430a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.789+0000 7f5b3430a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c1f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b3430a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c155040 0x7f5b2c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b3430a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c15b850 con 0x7f5b2c155040 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b3430a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c15b570 con 0x7f5b2c0c5950 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b3430a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2c15eb30 con 0x7f5b2c0b3540 2024-09-19T05:37:37.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c155040 0x7f5b2c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c155040 0x7f5b2c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44350/0 (socket says 172.21.15.103:44350) 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 -- 172.21.15.103:0/2277341594 learned_addr learned my addr 172.21.15.103:0/2277341594 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 -- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 msgr2=0x7f5b2c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b320a6640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b318a5640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c1f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 -- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b2c0c5950 msgr2=0x7f5b2c1f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c1f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 -- 172.21.15.103:0/2277341594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c0b5ee0 con 0x7f5b2c155040 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b318a5640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c1f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b320a6640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b328a7640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c155040 0x7f5b2c15a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009f70 tx=0x7f5b24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b22ffd640 1 -- 172.21.15.103:0/2277341594 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24036050 con 0x7f5b2c155040 2024-09-19T05:37:37.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b22ffd640 1 -- 172.21.15.103:0/2277341594 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b24042070 con 0x7f5b2c155040 2024-09-19T05:37:37.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.790+0000 7f5b22ffd640 1 -- 172.21.15.103:0/2277341594 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24009510 con 0x7f5b2c155040 2024-09-19T05:37:37.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.791+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2c1f50f0 con 0x7f5b2c155040 2024-09-19T05:37:37.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.791+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c0b66d0 con 0x7f5b2c155040 2024-09-19T05:37:37.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.792+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2c06be30 con 0x7f5b2c155040 2024-09-19T05:37:37.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.792+0000 7f5b22ffd640 1 -- 172.21.15.103:0/2277341594 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b24007bf0 con 0x7f5b2c155040 2024-09-19T05:37:37.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.792+0000 7f5b22ffd640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5b1006c2b0 0x7f5b1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:37.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.793+0000 7f5b22ffd640 1 -- 172.21.15.103:0/2277341594 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5b240abe30 con 0x7f5b2c155040 2024-09-19T05:37:37.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.793+0000 7f5b320a6640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5b1006c2b0 0x7f5b1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:37.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.793+0000 7f5b320a6640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5b1006c2b0 0x7f5b1006e770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5b28000f60 tx=0x7f5b28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:37.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.797+0000 7f5b22ffd640 1 -- 172.21.15.103:0/2277341594 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5b2c06be30 con 0x7f5b2c155040 2024-09-19T05:37:38.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.998+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b2c0cb540 con 0x7f5b2c155040 2024-09-19T05:37:38.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:37.998+0000 7f5b22ffd640 1 -- 172.21.15.103:0/2277341594 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f5b2403a360 con 0x7f5b2c155040 2024-09-19T05:37:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:38.001 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"btime":"2024-09-19T05:37:37:747940+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:37:38.001 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5b1006c2b0 msgr2=0x7f5b1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5b1006c2b0 0x7f5b1006e770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5b28000f60 tx=0x7f5b28009040 comp rx=0 tx=0).stop 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c155040 msgr2=0x7f5b2c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c155040 0x7f5b2c15a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009f70 tx=0x7f5b24004a40 comp rx=0 tx=0).stop 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 shutdown_connections 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5b1006c2b0 0x7f5b1006e770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b2c155040 0x7f5b2c15a360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b2c0c5950 0x7f5b2c1f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:38.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 --2- 172.21.15.103:0/2277341594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b2c0b3540 0x7f5b2c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 >> 172.21.15.103:0/2277341594 conn(0x7f5b2c073340 msgr2=0x7f5b2c153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 shutdown_connections 2024-09-19T05:37:38.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:38.000+0000 7f5b3430a640 1 -- 172.21.15.103:0/2277341594 wait complete. 2024-09-19T05:37:40.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.122+0000 7f16cb72a640 1 Processor -- start 2024-09-19T05:37:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.122+0000 7f16cb72a640 1 -- start start 2024-09-19T05:37:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.123+0000 7f16cb72a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 0x7f16c40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.123+0000 7f16cb72a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c40cb830 con 0x7f16c4155320 2024-09-19T05:37:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.123+0000 7f16cb72a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c40cbb10 con 0x7f16c4154f40 2024-09-19T05:37:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.123+0000 7f16cb72a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40cbdf0 con 0x7f16c40c66c0 2024-09-19T05:37:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.123+0000 7f16c8cc5640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f16c4155320 0x7f16c40c5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56694/0 (socket says 172.21.15.103:56694) 2024-09-19T05:37:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.123+0000 7f16c8cc5640 1 -- 172.21.15.103:0/368437989 learned_addr learned my addr 172.21.15.103:0/368437989 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c9cc7640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 0x7f16c40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277756250 0 0) 0x7f16c40cb830 con 0x7f16c4155320 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16b0003520 con 0x7f16c4155320 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224382550 0 0) 0x7f16c40cbb10 con 0x7f16c4154f40 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16c40cb830 con 0x7f16c4154f40 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3538176687 0 0) 0x7f16b0003520 con 0x7f16c4155320 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 msgr2=0x7f16c40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 0x7f16c40c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 >> v1:172.21.15.174:6789/0 conn(0x7f16c4154f40 legacy=0x7f16c40d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40c5a90 con 0x7f16c4155320 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f16b4001670 con 0x7f16c4155320 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 >> v1:172.21.15.103:6789/0 conn(0x7f16c4155320 legacy=0x7f16c40c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 0x7f16b0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16b00040d0 0x7f16b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40cbdf0 con 0x7f16b0004d40 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f16b000baa0 con 0x7f16b00040d0 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f16b000bca0 con 0x7f16c40c66c0 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c9cc7640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c8cc5640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16b00040d0 0x7f16b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c94c6640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 0x7f16b0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c9cc7640 1 -- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 msgr2=0x7f16b0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c9cc7640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c40c66c0 0x7f16b0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c9cc7640 1 -- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16b00040d0 msgr2=0x7f16b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c9cc7640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16b00040d0 0x7f16b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.124+0000 7f16c9cc7640 1 -- 172.21.15.103:0/368437989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b0003520 con 0x7f16b0004d40 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.125+0000 7f16c9cc7640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009ac0 tx=0x7f16b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfac5f273cb1ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.125+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc036070 con 0x7f16b0004d40 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.125+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc031400 con 0x7f16b0004d40 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.125+0000 7f16bbfff640 1 -- 172.21.15.103:0/368437989 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc009690 con 0x7f16b0004d40 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.126+0000 7f16cb72a640 1 -- 172.21.15.103:0/368437989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 msgr2=0x7f16b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.126+0000 7f16cb72a640 1 --2- 172.21.15.103:0/368437989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009ac0 tx=0x7f16b0005830 comp rx=0 tx=0).stop 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.126+0000 7f16c9cc7640 1 -- 172.21.15.103:0/368437989 reap_dead start 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.126+0000 7f16cb72a640 1 -- 172.21.15.103:0/368437989 shutdown_connections 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.126+0000 7f16cb72a640 1 -- 172.21.15.103:0/368437989 >> 172.21.15.103:0/368437989 conn(0x7f16c406bc10 msgr2=0x7f16c406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.126+0000 7f16cb72a640 1 -- 172.21.15.103:0/368437989 shutdown_connections 2024-09-19T05:37:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.126+0000 7f16cb72a640 1 -- 172.21.15.103:0/368437989 wait complete. 2024-09-19T05:37:40.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.127+0000 7f16cb72a640 1 Processor -- start 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.127+0000 7f16cb72a640 1 -- start start 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16cb72a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16c4148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16cb72a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c41441b0 0x7f16c41445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16cb72a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16c414fbf0 0x7f16c4150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16cb72a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40d1420 con 0x7f16b0004d40 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16cb72a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40d12a0 con 0x7f16c414fbf0 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16cb72a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40c75b0 con 0x7f16c41441b0 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16c4148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16c4148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44370/0 (socket says 172.21.15.103:44370) 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 -- 172.21.15.103:0/258598150 learned_addr learned my addr 172.21.15.103:0/258598150 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c9cc7640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16c414fbf0 0x7f16c4150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c8cc5640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c41441b0 0x7f16c41445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 -- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c41441b0 msgr2=0x7f16c41445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c41441b0 0x7f16c41445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 -- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16c414fbf0 msgr2=0x7f16c4150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16c414fbf0 0x7f16c4150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 -- 172.21.15.103:0/258598150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c4150ef0 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16c94c6640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16c4148780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16c000fae0 tx=0x7f16c000d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16b9ffb640 1 -- 172.21.15.103:0/258598150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0003b80 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.128+0000 7f16b9ffb640 1 -- 172.21.15.103:0/258598150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c0018070 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.129+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c4150c50 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.129+0000 7f16b9ffb640 1 -- 172.21.15.103:0/258598150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c000d8c0 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.129+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c41f1550 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.130+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c40cb1c0 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.130+0000 7f16b9ffb640 1 -- 172.21.15.103:0/258598150 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f16c000da60 con 0x7f16b0004d40 2024-09-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.130+0000 7f16b9ffb640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f16a806c2e0 0x7f16a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.131+0000 7f16b9ffb640 1 -- 172.21.15.103:0/258598150 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f16c008b220 con 0x7f16b0004d40 2024-09-19T05:37:40.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.131+0000 7f16c8cc5640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f16a806c2e0 0x7f16a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.131+0000 7f16c8cc5640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f16a806c2e0 0x7f16a806e7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f16c414db10 tx=0x7f16b4001e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.135+0000 7f16b9ffb640 1 -- 172.21.15.103:0/258598150 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f16c0059720 con 0x7f16b0004d40 2024-09-19T05:37:40.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.338+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16c40ca180 con 0x7f16b0004d40 2024-09-19T05:37:40.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.338+0000 7f16b9ffb640 1 -- 172.21.15.103:0/258598150 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5566 (secure 0 0 0) 0x7f16c005da20 con 0x7f16b0004d40 2024-09-19T05:37:40.341 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:40.341 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"btime":"2024-09-19T05:37:38:750904+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4302,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T05:37:40.342 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 3 2024-09-19T05:37:40.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f16a806c2e0 msgr2=0x7f16a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f16a806c2e0 0x7f16a806e7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f16c414db10 tx=0x7f16b4001e40 comp rx=0 tx=0).stop 2024-09-19T05:37:40.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 msgr2=0x7f16c4148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16c4148780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16c000fae0 tx=0x7f16c000d150 comp rx=0 tx=0).stop 2024-09-19T05:37:40.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 shutdown_connections 2024-09-19T05:37:40.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f16a806c2e0 0x7f16a806e7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16c414fbf0 0x7f16c4150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c41441b0 0x7f16c41445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 --2- 172.21.15.103:0/258598150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b0004d40 0x7f16c4148780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 >> 172.21.15.103:0/258598150 conn(0x7f16c406bc10 msgr2=0x7f16c4075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 shutdown_connections 2024-09-19T05:37:40.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.340+0000 7f16cb72a640 1 -- 172.21.15.103:0/258598150 wait complete. 2024-09-19T05:37:40.354 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T05:37:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.449+0000 7eff6ca50640 1 Processor -- start 2024-09-19T05:37:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.449+0000 7eff6ca50640 1 -- start start 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff6ca50640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff68070700 0x7eff680c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff6ca50640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff681556c0 con 0x7eff6815af30 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff6ca50640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6815b3e0 con 0x7eff681552e0 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff6ca50640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7eff680c82d0 con 0x7eff68070700 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff5dd9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7eff6815af30 0x7eff680c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56706/0 (socket says 172.21.15.103:56706) 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff5dd9b640 1 -- 172.21.15.103:0/222636512 learned_addr learned my addr 172.21.15.103:0/222636512 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057548047 0 0) 0x7eff50001110 con 0x7eff6815af30 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.450+0000 7eff66d9d640 1 --2- 172.21.15.103:0/222636512 >> v2:172.21.15.174:3300/0 conn(0x7eff68070700 0x7eff680c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff54003520 con 0x7eff6815af30 2024-09-19T05:37:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3411907544 0 0) 0x7eff54003520 con 0x7eff6815af30 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 >> v2:172.21.15.174:3300/0 conn(0x7eff68070700 msgr2=0x7eff680c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 --2- 172.21.15.103:0/222636512 >> v2:172.21.15.174:3300/0 conn(0x7eff68070700 0x7eff680c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 >> v1:172.21.15.174:6789/0 conn(0x7eff681552e0 legacy=0x7eff6806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6815b6c0 con 0x7eff6815af30 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7eff50001840 con 0x7eff6815af30 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 >> v1:172.21.15.103:6789/0 conn(0x7eff6815af30 legacy=0x7eff680c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff540039b0 0x7eff54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff54004800 0x7eff54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540051c0 0x7eff5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff5400c030 con 0x7eff540039b0 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7eff5400c1e0 con 0x7eff54004800 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7eff5400c3e0 con 0x7eff540051c0 2024-09-19T05:37:40.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff6659c640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff540039b0 0x7eff54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff5dd9b640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff54004800 0x7eff54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff66d9d640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540051c0 0x7eff5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff6659c640 1 -- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540051c0 msgr2=0x7eff5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff6659c640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540051c0 0x7eff5400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff6659c640 1 -- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff54004800 msgr2=0x7eff54004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff6659c640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff54004800 0x7eff54004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff66d9d640 1 -- 172.21.15.103:0/222636512 reap_dead start 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.451+0000 7eff6659c640 1 -- 172.21.15.103:0/222636512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff54003520 con 0x7eff540039b0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.452+0000 7eff6659c640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff540039b0 0x7eff54003dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff58001750 tx=0x7eff54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ccf3b541f7c0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.452+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58001370 con 0x7eff540039b0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.452+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff580052d0 con 0x7eff540039b0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.452+0000 7eff65d9b640 1 -- 172.21.15.103:0/222636512 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5802abc0 con 0x7eff540039b0 2024-09-19T05:37:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.452+0000 7eff6ca50640 1 -- 172.21.15.103:0/222636512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff540039b0 msgr2=0x7eff54003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.452+0000 7eff6ca50640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff540039b0 0x7eff54003dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff58001750 tx=0x7eff54005830 comp rx=0 tx=0).stop 2024-09-19T05:37:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.453+0000 7eff6ca50640 1 -- 172.21.15.103:0/222636512 shutdown_connections 2024-09-19T05:37:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.453+0000 7eff6ca50640 1 --2- 172.21.15.103:0/222636512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff540039b0 0x7eff54003dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.453+0000 7eff6ca50640 1 -- 172.21.15.103:0/222636512 >> 172.21.15.103:0/222636512 conn(0x7eff680ca140 msgr2=0x7eff680ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.453+0000 7eff6ca50640 1 -- 172.21.15.103:0/222636512 shutdown_connections 2024-09-19T05:37:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.453+0000 7eff6ca50640 1 -- 172.21.15.103:0/222636512 wait complete. 2024-09-19T05:37:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.454+0000 7eff6ca50640 1 Processor -- start 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.454+0000 7eff6ca50640 1 -- start start 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6ca50640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540039b0 0x7eff68146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6ca50640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff681455e0 0x7eff681f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6ca50640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff68072310 0x7eff68072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6ca50640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff6806fad0 con 0x7eff681455e0 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6ca50640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7eff6815bc80 con 0x7eff68072310 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6ca50640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7eff680c8cd0 con 0x7eff540039b0 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff681455e0 0x7eff681f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff681455e0 0x7eff681f3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44386/0 (socket says 172.21.15.103:44386) 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 -- 172.21.15.103:0/1822153728 learned_addr learned my addr 172.21.15.103:0/1822153728 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff66d9d640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff68072310 0x7eff68072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6659c640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540039b0 0x7eff68146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 -- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540039b0 msgr2=0x7eff68146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540039b0 0x7eff68146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 -- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff68072310 msgr2=0x7eff68072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff68072310 0x7eff68072790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 -- 172.21.15.103:0/1822153728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff681f25b0 con 0x7eff681455e0 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5dd9b640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff681455e0 0x7eff681f3db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff50004fa0 tx=0x7eff500074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5f7fe640 1 -- 172.21.15.103:0/1822153728 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5000f720 con 0x7eff681455e0 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5f7fe640 1 -- 172.21.15.103:0/1822153728 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff50018070 con 0x7eff681455e0 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff68145d40 con 0x7eff681455e0 2024-09-19T05:37:40.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.455+0000 7eff5f7fe640 1 -- 172.21.15.103:0/1822153728 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5000fb20 con 0x7eff681455e0 2024-09-19T05:37:40.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.456+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff68146300 con 0x7eff681455e0 2024-09-19T05:37:40.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.457+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff680cd3b0 con 0x7eff681455e0 2024-09-19T05:37:40.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.457+0000 7eff5f7fe640 1 -- 172.21.15.103:0/1822153728 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7eff5000fcc0 con 0x7eff681455e0 2024-09-19T05:37:40.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.457+0000 7eff5f7fe640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7eff4806c2e0 0x7eff4806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.457+0000 7eff6659c640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7eff4806c2e0 0x7eff4806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.457+0000 7eff5f7fe640 1 -- 172.21.15.103:0/1822153728 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7eff5008aa80 con 0x7eff681455e0 2024-09-19T05:37:40.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.458+0000 7eff6659c640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7eff4806c2e0 0x7eff4806e7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff58032000 tx=0x7eff5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.462+0000 7eff5f7fe640 1 -- 172.21.15.103:0/1822153728 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7eff680cd3b0 con 0x7eff681455e0 2024-09-19T05:37:40.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.627+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7eff6806bc10 con 0x7eff681455e0 2024-09-19T05:37:40.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.628+0000 7eff5f7fe640 1 -- 172.21.15.103:0/1822153728 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7eff681556c0 con 0x7eff681455e0 2024-09-19T05:37:40.630 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:40.630 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-19T05:37:40.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:37:40.630 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-19T05:37:40.631 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-19T05:37:40.631 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:37:40.631 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-19T05:37:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.629+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7eff4806c2e0 msgr2=0x7eff4806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.629+0000 7eff6ca50640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7eff4806c2e0 0x7eff4806e7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff58032000 tx=0x7eff5802e000 comp rx=0 tx=0).stop 2024-09-19T05:37:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.629+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff681455e0 msgr2=0x7eff681f3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.629+0000 7eff6ca50640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff681455e0 0x7eff681f3db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff50004fa0 tx=0x7eff500074f0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 shutdown_connections 2024-09-19T05:37:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7eff4806c2e0 0x7eff4806e7a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff68072310 0x7eff68072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff681455e0 0x7eff681f3db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 --2- 172.21.15.103:0/1822153728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff540039b0 0x7eff68146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 >> 172.21.15.103:0/1822153728 conn(0x7eff680ca140 msgr2=0x7eff68159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 shutdown_connections 2024-09-19T05:37:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.630+0000 7eff6ca50640 1 -- 172.21.15.103:0/1822153728 wait complete. 2024-09-19T05:37:40.643 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:37:40.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:37:40.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.742+0000 7f336f2b7640 1 Processor -- start 2024-09-19T05:37:40.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.742+0000 7f336f2b7640 1 -- start start 2024-09-19T05:37:40.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336f2b7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368155050 0x7f336815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336f2b7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3368073e50 0x7f33680d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336f2b7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33680cc0f0 con 0x7f33680d0d10 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336f2b7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f33680ccfc0 con 0x7f3368073e50 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336f2b7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f336815be20 con 0x7f3368155050 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336c852640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3368073e50 0x7f33680d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336c852640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3368073e50 0x7f33680d07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44396/0 (socket says 172.21.15.103:44396) 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336c852640 1 -- 172.21.15.103:0/2282378203 learned_addr learned my addr 172.21.15.103:0/2282378203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336c852640 1 -- 172.21.15.103:0/2282378203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368155050 msgr2=0x7f336815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336d053640 1 --2- 172.21.15.103:0/2282378203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368155050 0x7f336815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336c852640 1 --2- 172.21.15.103:0/2282378203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368155050 0x7f336815b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336c852640 1 -- 172.21.15.103:0/2282378203 >> v1:172.21.15.174:6789/0 conn(0x7f33680d0d10 legacy=0x7f336806bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.743+0000 7f336c852640 1 -- 172.21.15.103:0/2282378203 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33680cc3b0 con 0x7f3368073e50 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.744+0000 7f336c852640 1 --2- 172.21.15.103:0/2282378203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3368073e50 0x7f33680d07d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3358009870 tx=0x7f335802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faae962ecd5549dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.744+0000 7f335ffff640 1 -- 172.21.15.103:0/2282378203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358037070 con 0x7f3368073e50 2024-09-19T05:37:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.744+0000 7f335ffff640 1 -- 172.21.15.103:0/2282378203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3358032440 con 0x7f3368073e50 2024-09-19T05:37:40.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.744+0000 7f335ffff640 1 -- 172.21.15.103:0/2282378203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358032810 con 0x7f3368073e50 2024-09-19T05:37:40.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.744+0000 7f336f2b7640 1 -- 172.21.15.103:0/2282378203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3368073e50 msgr2=0x7f33680d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.744+0000 7f336f2b7640 1 --2- 172.21.15.103:0/2282378203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3368073e50 0x7f33680d07d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3358009870 tx=0x7f335802a2a0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.745+0000 7f336f2b7640 1 -- 172.21.15.103:0/2282378203 shutdown_connections 2024-09-19T05:37:40.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.745+0000 7f336f2b7640 1 --2- 172.21.15.103:0/2282378203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3368073e50 0x7f33680d07d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.745+0000 7f336f2b7640 1 --2- 172.21.15.103:0/2282378203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368155050 0x7f336815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.745+0000 7f336f2b7640 1 -- 172.21.15.103:0/2282378203 >> 172.21.15.103:0/2282378203 conn(0x7f336806dee0 msgr2=0x7f3368073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.745+0000 7f336f2b7640 1 -- 172.21.15.103:0/2282378203 shutdown_connections 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.745+0000 7f336f2b7640 1 -- 172.21.15.103:0/2282378203 wait complete. 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.746+0000 7f336f2b7640 1 Processor -- start 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.746+0000 7f336f2b7640 1 -- start start 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.746+0000 7f336f2b7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368073e50 0x7f336814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336f2b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33680d0d10 0x7f33680b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336f2b7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3368155050 0x7f33680b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336f2b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f33680ccc50 con 0x7f33680d0d10 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336f2b7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f33680cc970 con 0x7f3368155050 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336f2b7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f33680cb640 con 0x7f3368073e50 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33680d0d10 0x7f33680b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33680d0d10 0x7f33680b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44400/0 (socket says 172.21.15.103:44400) 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 -- 172.21.15.103:0/390670201 learned_addr learned my addr 172.21.15.103:0/390670201 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 -- 172.21.15.103:0/390670201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368073e50 msgr2=0x7f336814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368073e50 0x7f336814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 -- 172.21.15.103:0/390670201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3368155050 msgr2=0x7f33680b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3368155050 0x7f33680b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 -- 172.21.15.103:0/390670201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33680cf590 con 0x7f33680d0d10 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336c852640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33680d0d10 0x7f33680b5060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3358009870 tx=0x7f33580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f335dffb640 1 -- 172.21.15.103:0/390670201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358041020 con 0x7f33680d0d10 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f335dffb640 1 -- 172.21.15.103:0/390670201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3358030970 con 0x7f33680d0d10 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33680cf850 con 0x7f33680d0d10 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f335dffb640 1 -- 172.21.15.103:0/390670201 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358037040 con 0x7f33680d0d10 2024-09-19T05:37:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.747+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33680cfe10 con 0x7f33680d0d10 2024-09-19T05:37:40.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.748+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3368155430 con 0x7f33680d0d10 2024-09-19T05:37:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.749+0000 7f335dffb640 1 -- 172.21.15.103:0/390670201 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3358044020 con 0x7f33680d0d10 2024-09-19T05:37:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.749+0000 7f335dffb640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f334c06c2b0 0x7f334c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.749+0000 7f335dffb640 1 -- 172.21.15.103:0/390670201 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f33580abb50 con 0x7f33680d0d10 2024-09-19T05:37:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.749+0000 7f336d053640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f334c06c2b0 0x7f334c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.750+0000 7f336d053640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f334c06c2b0 0x7f334c06e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f336400a810 tx=0x7f3364008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:40.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.754+0000 7f335dffb640 1 -- 172.21.15.103:0/390670201 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f335804b030 con 0x7f33680d0d10 2024-09-19T05:37:40.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:40.919+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f336814eac0 con 0x7f33680d0d10 2024-09-19T05:37:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.763+0000 7f335dffb640 1 -- 172.21.15.103:0/390670201 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f335807a610 con 0x7f33680d0d10 2024-09-19T05:37:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-19T05:37:41.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.766+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f334c06c2b0 msgr2=0x7f334c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.766+0000 7f336f2b7640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f334c06c2b0 0x7f334c06e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f336400a810 tx=0x7f3364008040 comp rx=0 tx=0).stop 2024-09-19T05:37:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.766+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33680d0d10 msgr2=0x7f33680b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.766+0000 7f336f2b7640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33680d0d10 0x7f33680b5060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3358009870 tx=0x7f33580046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.766+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 shutdown_connections 2024-09-19T05:37:41.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.767+0000 7f336f2b7640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f334c06c2b0 0x7f334c06e770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.767+0000 7f336f2b7640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3368155050 0x7f33680b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.767+0000 7f336f2b7640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33680d0d10 0x7f33680b5060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.767+0000 7f336f2b7640 1 --2- 172.21.15.103:0/390670201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3368073e50 0x7f336814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.767+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 >> 172.21.15.103:0/390670201 conn(0x7f336806dee0 msgr2=0x7f33681502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:41.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.768+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 shutdown_connections 2024-09-19T05:37:41.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.769+0000 7f336f2b7640 1 -- 172.21.15.103:0/390670201 wait complete. 2024-09-19T05:37:41.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T05:37:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.897+0000 7f1ea259f640 1 Processor -- start 2024-09-19T05:37:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.897+0000 7f1ea259f640 1 -- start start 2024-09-19T05:37:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea259f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1e9c154f30 0x7f1e9c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea259f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1e9c0cb430 0x7f1e9c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea259f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea259f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1e9c0cbe80 con 0x7f1e9c154f30 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea259f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f1e9c15f140 con 0x7f1e9c0cb430 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea259f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c15e2e0 con 0x7f1e9c0ccb40 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1e9c154f30 0x7f1e9c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1e9c154f30 0x7f1e9c0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60054/0 (socket says 172.21.15.103:60054) 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 -- 172.21.15.103:0/1804509131 learned_addr learned my addr 172.21.15.103:0/1804509131 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea0d9c640 1 --2- 172.21.15.103:0/1804509131 >> v2:172.21.15.174:3300/0 conn(0x7f1e9c0cb430 0x7f1e9c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 -- 172.21.15.103:0/1804509131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 msgr2=0x7f1e9c0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea1d9e640 1 --2- 172.21.15.103:0/1804509131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 --2- 172.21.15.103:0/1804509131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c0cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 -- 172.21.15.103:0/1804509131 >> v2:172.21.15.174:3300/0 conn(0x7f1e9c0cb430 msgr2=0x7f1e9c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 --2- 172.21.15.103:0/1804509131 >> v2:172.21.15.174:3300/0 conn(0x7f1e9c0cb430 0x7f1e9c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea159d640 1 -- 172.21.15.103:0/1804509131 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c15e5c0 con 0x7f1e9c154f30 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea0d9c640 1 --2- 172.21.15.103:0/1804509131 >> v2:172.21.15.174:3300/0 conn(0x7f1e9c0cb430 0x7f1e9c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.898+0000 7f1ea1d9e640 1 --2- 172.21.15.103:0/1804509131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c0cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.899+0000 7f1ea159d640 1 --2- 172.21.15.103:0/1804509131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c0cc600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c158860 tx=0x7f1e9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722aecb7f78c528a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.899+0000 7f1e93fff640 1 -- 172.21.15.103:0/1804509131 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98037070 con 0x7f1e9c154f30 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.899+0000 7f1e93fff640 1 -- 172.21.15.103:0/1804509131 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98032440 con 0x7f1e9c154f30 2024-09-19T05:37:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.899+0000 7f1e93fff640 1 -- 172.21.15.103:0/1804509131 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98032810 con 0x7f1e9c154f30 2024-09-19T05:37:41.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 -- 172.21.15.103:0/1804509131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 msgr2=0x7f1e9c0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 --2- 172.21.15.103:0/1804509131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c0cc600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c158860 tx=0x7f1e9802a270 comp rx=0 tx=0).stop 2024-09-19T05:37:41.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 -- 172.21.15.103:0/1804509131 shutdown_connections 2024-09-19T05:37:41.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 --2- 172.21.15.103:0/1804509131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c0cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 --2- 172.21.15.103:0/1804509131 >> v2:172.21.15.174:3300/0 conn(0x7f1e9c0cb430 0x7f1e9c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 --2- 172.21.15.103:0/1804509131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c0cc600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 -- 172.21.15.103:0/1804509131 >> 172.21.15.103:0/1804509131 conn(0x7f1e9c06d5c0 msgr2=0x7f1e9c06d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 -- 172.21.15.103:0/1804509131 shutdown_connections 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.900+0000 7f1ea259f640 1 -- 172.21.15.103:0/1804509131 wait complete. 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.901+0000 7f1ea259f640 1 Processor -- start 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.901+0000 7f1ea259f640 1 -- start start 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea259f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e9c0cb430 0x7f1e9c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea259f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea259f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c1f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea259f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c15ee60 con 0x7f1e9c154f30 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea259f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c15eb80 con 0x7f1e9c0cb430 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea259f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c155310 con 0x7f1e9c0ccb40 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c1f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c1f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60068/0 (socket says 172.21.15.103:60068) 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 -- 172.21.15.103:0/3816252818 learned_addr learned my addr 172.21.15.103:0/3816252818 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea159d640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e9c0cb430 0x7f1e9c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea0d9c640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 -- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 msgr2=0x7f1e9c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 -- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e9c0cb430 msgr2=0x7f1e9c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e9c0cb430 0x7f1e9c152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 -- 172.21.15.103:0/3816252818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c153290 con 0x7f1e9c154f30 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea1d9e640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c1f3ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400cf20 tx=0x7f1e9400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1e91ffb640 1 -- 172.21.15.103:0/3816252818 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9401a070 con 0x7f1e9c154f30 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1e91ffb640 1 -- 172.21.15.103:0/3816252818 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9400d840 con 0x7f1e9c154f30 2024-09-19T05:37:41.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c0b4740 con 0x7f1e9c154f30 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.902+0000 7f1e91ffb640 1 -- 172.21.15.103:0/3816252818 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400dc30 con 0x7f1e9c154f30 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.903+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9c0b4cc0 con 0x7f1e9c154f30 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.904+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9c0cc600 con 0x7f1e9c154f30 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.904+0000 7f1e91ffb640 1 -- 172.21.15.103:0/3816252818 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1e9401d070 con 0x7f1e9c154f30 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.904+0000 7f1e91ffb640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1e8006c2b0 0x7f1e8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.905+0000 7f1e91ffb640 1 -- 172.21.15.103:0/3816252818 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f1e9408ba10 con 0x7f1e9c154f30 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.905+0000 7f1ea159d640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1e8006c2b0 0x7f1e8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.905+0000 7f1ea159d640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1e8006c2b0 0x7f1e8006e770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e98034000 tx=0x7f1e9802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:41.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:41.909+0000 7f1e91ffb640 1 -- 172.21.15.103:0/3816252818 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1e94059d10 con 0x7f1e9c154f30 2024-09-19T05:37:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.078+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f1e9c14ad00 con 0x7f1e9c154f30 2024-09-19T05:37:42.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:42.105 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:37:42.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.768+0000 7f1e91ffb640 1 -- 172.21.15.103:0/3816252818 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f1e9405e010 con 0x7f1e9c154f30 2024-09-19T05:37:42.771 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-19T05:37:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.771+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1e8006c2b0 msgr2=0x7f1e8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1e8006c2b0 0x7f1e8006e770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e98034000 tx=0x7f1e9802e000 comp rx=0 tx=0).stop 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 msgr2=0x7f1e9c1f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c1f3ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400cf20 tx=0x7f1e9400a7d0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 shutdown_connections 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1e8006c2b0 0x7f1e8006e770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e9c154f30 0x7f1e9c1f3ab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9c0ccb40 0x7f1e9c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 --2- 172.21.15.103:0/3816252818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e9c0cb430 0x7f1e9c152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 >> 172.21.15.103:0/3816252818 conn(0x7f1e9c06d5c0 msgr2=0x7f1e9c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 shutdown_connections 2024-09-19T05:37:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.772+0000 7f1ea259f640 1 -- 172.21.15.103:0/3816252818 wait complete. 2024-09-19T05:37:42.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:37:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.902+0000 7fa043f52640 1 Processor -- start 2024-09-19T05:37:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.903+0000 7fa043f52640 1 -- start start 2024-09-19T05:37:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.903+0000 7fa043f52640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 0x7fa03c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.903+0000 7fa043f52640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa03c1596c0 con 0x7fa03c151d80 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.903+0000 7fa043f52640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa03c06f9d0 con 0x7fa03c0c8a20 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.903+0000 7fa043f52640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa03c0c9e70 con 0x7fa03c0c8e20 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa041cee640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa03c151d80 0x7fa03c158fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46466/0 (socket says 172.21.15.103:46466) 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa041cee640 1 -- 172.21.15.103:0/3687469858 learned_addr learned my addr 172.21.15.103:0/3687469858 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0424ef640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 0x7fa03c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531096463 0 0) 0x7fa03c1596c0 con 0x7fa03c151d80 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa028003520 con 0x7fa03c151d80 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3620251432 0 0) 0x7fa028003520 con 0x7fa03c151d80 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 msgr2=0x7fa03c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 0x7fa03c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 >> v1:172.21.15.174:6789/0 conn(0x7fa03c0c8a20 legacy=0x7fa03c15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c06fcb0 con 0x7fa03c151d80 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fa030001670 con 0x7fa03c151d80 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 >> v1:172.21.15.103:6789/0 conn(0x7fa03c151d80 legacy=0x7fa03c158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0280039e0 0x7fa028003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa028004390 0x7fa028004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 0x7fa0280050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0c9e70 con 0x7fa028004390 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa02800b9f0 con 0x7fa0280039e0 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa02800de00 con 0x7fa03c0c8e20 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0414ed640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa028004390 0x7fa028004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa041cee640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0280039e0 0x7fa028003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0424ef640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 0x7fa0280050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0414ed640 1 -- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 msgr2=0x7fa0280050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0414ed640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c0c8e20 0x7fa0280050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0414ed640 1 -- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0280039e0 msgr2=0x7fa028003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0414ed640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0280039e0 0x7fa028003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.904+0000 7fa0414ed640 1 -- 172.21.15.103:0/3687469858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa028003520 con 0x7fa028004390 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.905+0000 7fa0414ed640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa028004390 0x7fa028004860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa038001860 tx=0x7fa028005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598268a49b40111c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.905+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038037070 con 0x7fa028004390 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.905+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03802abf0 con 0x7fa028004390 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.905+0000 7fa040cec640 1 -- 172.21.15.103:0/3687469858 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038001430 con 0x7fa028004390 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.906+0000 7fa043f52640 1 -- 172.21.15.103:0/3687469858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa028004390 msgr2=0x7fa028004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.906+0000 7fa043f52640 1 --2- 172.21.15.103:0/3687469858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa028004390 0x7fa028004860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa038001860 tx=0x7fa028005830 comp rx=0 tx=0).stop 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.906+0000 7fa0424ef640 1 -- 172.21.15.103:0/3687469858 reap_dead start 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.906+0000 7fa043f52640 1 -- 172.21.15.103:0/3687469858 shutdown_connections 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.906+0000 7fa043f52640 1 -- 172.21.15.103:0/3687469858 >> 172.21.15.103:0/3687469858 conn(0x7fa03c0ca140 msgr2=0x7fa03c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.906+0000 7fa043f52640 1 -- 172.21.15.103:0/3687469858 shutdown_connections 2024-09-19T05:37:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.906+0000 7fa043f52640 1 -- 172.21.15.103:0/3687469858 wait complete. 2024-09-19T05:37:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.907+0000 7fa043f52640 1 Processor -- start 2024-09-19T05:37:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.907+0000 7fa043f52640 1 -- start start 2024-09-19T05:37:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa043f52640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa028004390 0x7fa03c1eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa043f52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c157df0 0x7fa03c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa043f52640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c158660 0x7fa03c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa043f52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c070550 con 0x7fa03c157df0 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa043f52640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c070270 con 0x7fa028004390 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa043f52640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa03c070830 con 0x7fa03c158660 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c157df0 0x7fa03c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c157df0 0x7fa03c06d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60076/0 (socket says 172.21.15.103:60076) 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 -- 172.21.15.103:0/249413335 learned_addr learned my addr 172.21.15.103:0/249413335 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa041cee640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa028004390 0x7fa03c1eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0424ef640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c158660 0x7fa03c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 -- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c158660 msgr2=0x7fa03c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c158660 0x7fa03c06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 -- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa028004390 msgr2=0x7fa03c1eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa028004390 0x7fa03c1eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 -- 172.21.15.103:0/249413335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c157310 con 0x7fa03c157df0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.908+0000 7fa0414ed640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c157df0 0x7fa03c06d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa038001980 tx=0x7fa038001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.909+0000 7fa02e7fc640 1 -- 172.21.15.103:0/249413335 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03803f020 con 0x7fa03c157df0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.909+0000 7fa02e7fc640 1 -- 172.21.15.103:0/249413335 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa038005270 con 0x7fa03c157df0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.909+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03c1ef1c0 con 0x7fa03c157df0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.909+0000 7fa02e7fc640 1 -- 172.21.15.103:0/249413335 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038037040 con 0x7fa03c157df0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.909+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c1578b0 con 0x7fa03c157df0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.910+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03c074700 con 0x7fa03c157df0 2024-09-19T05:37:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.910+0000 7fa02e7fc640 1 -- 172.21.15.103:0/249413335 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa038042020 con 0x7fa03c157df0 2024-09-19T05:37:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.911+0000 7fa02e7fc640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa02006c2b0 0x7fa02006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.911+0000 7fa041cee640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa02006c2b0 0x7fa02006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.911+0000 7fa02e7fc640 1 -- 172.21.15.103:0/249413335 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fa0380aaf10 con 0x7fa03c157df0 2024-09-19T05:37:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.911+0000 7fa041cee640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa02006c2b0 0x7fa02006e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa030000f60 tx=0x7fa030000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:42.915+0000 7fa02e7fc640 1 -- 172.21.15.103:0/249413335 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa03c074700 con 0x7fa03c157df0 2024-09-19T05:37:43.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.116+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa03c157af0 con 0x7fa03c157df0 2024-09-19T05:37:43.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.770+0000 7fa02e7fc640 1 -- 172.21.15.103:0/249413335 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa038049030 con 0x7fa03c157df0 2024-09-19T05:37:43.773 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.773+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa02006c2b0 msgr2=0x7fa02006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.773+0000 7fa043f52640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa02006c2b0 0x7fa02006e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa030000f60 tx=0x7fa030000ed0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.773+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c157df0 msgr2=0x7fa03c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.773+0000 7fa043f52640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c157df0 0x7fa03c06d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa038001980 tx=0x7fa038001230 comp rx=0 tx=0).stop 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 shutdown_connections 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa02006c2b0 0x7fa02006e770 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03c158660 0x7fa03c06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c157df0 0x7fa03c06d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 --2- 172.21.15.103:0/249413335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa028004390 0x7fa03c1eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 >> 172.21.15.103:0/249413335 conn(0x7fa03c0ca140 msgr2=0x7fa03c14d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:43.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 shutdown_connections 2024-09-19T05:37:43.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.774+0000 7fa043f52640 1 -- 172.21.15.103:0/249413335 wait complete. 2024-09-19T05:37:43.800 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T05:37:43.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T05:37:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.904+0000 7f92ac531640 1 Processor -- start 2024-09-19T05:37:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.904+0000 7f92ac531640 1 -- start start 2024-09-19T05:37:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.905+0000 7f92ac531640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4154f20 0x7f92a4073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.905+0000 7f92ac531640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f92a406d710 0x7f92a4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.905+0000 7f92ac531640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a415b320 con 0x7f92a4155300 2024-09-19T05:37:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.905+0000 7f92ac531640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f92a4070bd0 con 0x7f92a406d710 2024-09-19T05:37:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.905+0000 7f92ac531640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f92a4070eb0 con 0x7f92a4154f20 2024-09-19T05:37:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92aa2cd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4154f20 0x7f92a4073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92a9acc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f92a406d710 0x7f92a4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92aaace640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f92a4155300 0x7f92a40cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:53486/0 (socket says 172.21.15.103:53486) 2024-09-19T05:37:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92aaace640 1 -- 172.21.15.103:0/4063628426 learned_addr learned my addr 172.21.15.103:0/4063628426 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92a9acc640 1 -- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4154f20 msgr2=0x7f92a4073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92a9acc640 1 --2- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4154f20 0x7f92a4073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92a9acc640 1 -- 172.21.15.103:0/4063628426 >> v1:172.21.15.174:6789/0 conn(0x7f92a4155300 legacy=0x7f92a40cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92a9acc640 1 -- 172.21.15.103:0/4063628426 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a415b5c0 con 0x7f92a406d710 2024-09-19T05:37:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.906+0000 7f92aa2cd640 1 --2- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4154f20 0x7f92a4073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.907+0000 7f92a9acc640 1 --2- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 0x7f92a4071340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f92a4070d50 tx=0x7f929402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43fbbd347897db02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.907+0000 7f92a92cb640 1 -- 172.21.15.103:0/4063628426 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294037070 con 0x7f92a406d710 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.907+0000 7f92a92cb640 1 -- 172.21.15.103:0/4063628426 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9294032440 con 0x7f92a406d710 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.907+0000 7f92a92cb640 1 -- 172.21.15.103:0/4063628426 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294032810 con 0x7f92a406d710 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 -- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 msgr2=0x7f92a4071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 --2- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 0x7f92a4071340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f92a4070d50 tx=0x7f929402a180 comp rx=0 tx=0).stop 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 -- 172.21.15.103:0/4063628426 shutdown_connections 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 --2- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 0x7f92a4071340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 --2- 172.21.15.103:0/4063628426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4154f20 0x7f92a4073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 -- 172.21.15.103:0/4063628426 >> 172.21.15.103:0/4063628426 conn(0x7f92a4067890 msgr2=0x7f92a4067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 -- 172.21.15.103:0/4063628426 shutdown_connections 2024-09-19T05:37:43.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.908+0000 7f92ac531640 1 -- 172.21.15.103:0/4063628426 wait complete. 2024-09-19T05:37:43.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.909+0000 7f92ac531640 1 Processor -- start 2024-09-19T05:37:43.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.909+0000 7f92ac531640 1 -- start start 2024-09-19T05:37:43.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92ac531640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 0x7f92a41e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:43.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92ac531640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a4154f20 0x7f92a41e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:43.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92ac531640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4155300 0x7f92a414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92ac531640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40743e0 con 0x7f92a4154f20 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92ac531640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f92a415bb80 con 0x7f92a406d710 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92ac531640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f92a4074560 con 0x7f92a4155300 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a4154f20 0x7f92a41e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a4154f20 0x7f92a41e5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60088/0 (socket says 172.21.15.103:60088) 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92aa2cd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 0x7f92a41e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 -- 172.21.15.103:0/3810808327 learned_addr learned my addr 172.21.15.103:0/3810808327 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92aaace640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4155300 0x7f92a414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:43.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 -- 172.21.15.103:0/3810808327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4155300 msgr2=0x7f92a414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4155300 0x7f92a414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 -- 172.21.15.103:0/3810808327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 msgr2=0x7f92a41e2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 0x7f92a41e2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 -- 172.21.15.103:0/3810808327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a40cf350 con 0x7f92a4154f20 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92a9acc640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a4154f20 0x7f92a41e5490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9294009890 tx=0x7f92940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f929affd640 1 -- 172.21.15.103:0/3810808327 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294037040 con 0x7f92a4154f20 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f929affd640 1 -- 172.21.15.103:0/3810808327 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9294042070 con 0x7f92a4154f20 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a41f0db0 con 0x7f92a4154f20 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.910+0000 7f929affd640 1 -- 172.21.15.103:0/3810808327 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294030960 con 0x7f92a4154f20 2024-09-19T05:37:43.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.911+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a41e23e0 con 0x7f92a4154f20 2024-09-19T05:37:43.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.912+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a415ade0 con 0x7f92a4154f20 2024-09-19T05:37:43.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.912+0000 7f929affd640 1 -- 172.21.15.103:0/3810808327 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9294030b00 con 0x7f92a4154f20 2024-09-19T05:37:43.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.912+0000 7f929affd640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f928806c2b0 0x7f928806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:43.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.912+0000 7f929affd640 1 -- 172.21.15.103:0/3810808327 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f92940abc30 con 0x7f92a4154f20 2024-09-19T05:37:43.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.912+0000 7f92aa2cd640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f928806c2b0 0x7f928806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:43.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.913+0000 7f92aa2cd640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f928806c2b0 0x7f928806e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009560 tx=0x7f92a0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:43.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:43.917+0000 7f929affd640 1 -- 172.21.15.103:0/3810808327 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9294079d60 con 0x7f92a4154f20 2024-09-19T05:37:44.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.093+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f92a4154060 con 0x7f92a4154f20 2024-09-19T05:37:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.788+0000 7f929affd640 1 -- 172.21.15.103:0/3810808327 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f929407e060 con 0x7f92a4154f20 2024-09-19T05:37:44.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f928806c2b0 msgr2=0x7f928806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:44.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f928806c2b0 0x7f928806e770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009560 tx=0x7f92a0009190 comp rx=0 tx=0).stop 2024-09-19T05:37:44.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a4154f20 msgr2=0x7f92a41e5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:44.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a4154f20 0x7f92a41e5490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9294009890 tx=0x7f92940046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 shutdown_connections 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f928806c2b0 0x7f928806e770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92a4155300 0x7f92a414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a4154f20 0x7f92a41e5490 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.790+0000 7f92ac531640 1 --2- 172.21.15.103:0/3810808327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92a406d710 0x7f92a41e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.791+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 >> 172.21.15.103:0/3810808327 conn(0x7f92a4067890 msgr2=0x7f92a4152740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.791+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 shutdown_connections 2024-09-19T05:37:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.791+0000 7f92ac531640 1 -- 172.21.15.103:0/3810808327 wait complete. 2024-09-19T05:37:44.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:37:44.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.910+0000 7f5e5245c640 1 Processor -- start 2024-09-19T05:37:44.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.910+0000 7f5e5245c640 1 -- start start 2024-09-19T05:37:44.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e5245c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c154e60 0x7f5e4c15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:44.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e5245c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e4c0cf3e0 0x7f5e4c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:44.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e5245c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c06d890 con 0x7f5e4c06d260 2024-09-19T05:37:44.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e5245c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c0735a0 con 0x7f5e4c0cf3e0 2024-09-19T05:37:44.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e5245c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c15bde0 con 0x7f5e4c154e60 2024-09-19T05:37:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e4b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e4c0cf3e0 0x7f5e4c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e4b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e4c0cf3e0 0x7f5e4c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60092/0 (socket says 172.21.15.103:60092) 2024-09-19T05:37:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e4b7fe640 1 -- 172.21.15.103:0/3942660464 learned_addr learned my addr 172.21.15.103:0/3942660464 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e4b7fe640 1 -- 172.21.15.103:0/3942660464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c154e60 msgr2=0x7f5e4c15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e4b7fe640 1 --2- 172.21.15.103:0/3942660464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c154e60 0x7f5e4c15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e4b7fe640 1 -- 172.21.15.103:0/3942660464 >> v1:172.21.15.174:6789/0 conn(0x7f5e4c06d260 legacy=0x7f5e4c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.911+0000 7f5e4b7fe640 1 -- 172.21.15.103:0/3942660464 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0737d0 con 0x7f5e4c0cf3e0 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.912+0000 7f5e4b7fe640 1 --2- 172.21.15.103:0/3942660464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c0cf3e0 0x7f5e4c06cd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009870 tx=0x7f5e4002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a0eaa50e980292 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.912+0000 7f5e4affd640 1 -- 172.21.15.103:0/3942660464 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40037070 con 0x7f5e4c0cf3e0 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.912+0000 7f5e4affd640 1 -- 172.21.15.103:0/3942660464 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40032440 con 0x7f5e4c0cf3e0 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.912+0000 7f5e4affd640 1 -- 172.21.15.103:0/3942660464 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40032810 con 0x7f5e4c0cf3e0 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 -- 172.21.15.103:0/3942660464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c0cf3e0 msgr2=0x7f5e4c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 --2- 172.21.15.103:0/3942660464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c0cf3e0 0x7f5e4c06cd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009870 tx=0x7f5e4002a2a0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 -- 172.21.15.103:0/3942660464 shutdown_connections 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 --2- 172.21.15.103:0/3942660464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c0cf3e0 0x7f5e4c06cd20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 --2- 172.21.15.103:0/3942660464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c154e60 0x7f5e4c15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 -- 172.21.15.103:0/3942660464 >> 172.21.15.103:0/3942660464 conn(0x7f5e4c0ce8c0 msgr2=0x7f5e4c0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 -- 172.21.15.103:0/3942660464 shutdown_connections 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.913+0000 7f5e5245c640 1 -- 172.21.15.103:0/3942660464 wait complete. 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.914+0000 7f5e5245c640 1 Processor -- start 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.914+0000 7f5e5245c640 1 -- start start 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c06d260 0x7f5e4c1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e4c0cf3e0 0x7f5e4c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c154e60 0x7f5e4c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c074070 con 0x7f5e4c154e60 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c073d90 con 0x7f5e4c0cf3e0 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c074350 con 0x7f5e4c06d260 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c154e60 0x7f5e4c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c154e60 0x7f5e4c157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60098/0 (socket says 172.21.15.103:60098) 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 -- 172.21.15.103:0/1374806016 learned_addr learned my addr 172.21.15.103:0/1374806016 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e4b7fe640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e4c0cf3e0 0x7f5e4c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e4bfff640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c06d260 0x7f5e4c1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 -- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c06d260 msgr2=0x7f5e4c1f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c06d260 0x7f5e4c1f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 -- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e4c0cf3e0 msgr2=0x7f5e4c1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e4c0cf3e0 0x7f5e4c1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 -- 172.21.15.103:0/1374806016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0ca6e0 con 0x7f5e4c154e60 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e509f9640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c154e60 0x7f5e4c157ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400b9c0 tx=0x7f5e4400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e48ff9640 1 -- 172.21.15.103:0/1374806016 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44019070 con 0x7f5e4c154e60 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e48ff9640 1 -- 172.21.15.103:0/1374806016 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4400cb40 con 0x7f5e4c154e60 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e48ff9640 1 -- 172.21.15.103:0/1374806016 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44014440 con 0x7f5e4c154e60 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c14bab0 con 0x7f5e4c154e60 2024-09-19T05:37:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.915+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c14b7d0 con 0x7f5e4c154e60 2024-09-19T05:37:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.916+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4c155240 con 0x7f5e4c154e60 2024-09-19T05:37:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.917+0000 7f5e48ff9640 1 -- 172.21.15.103:0/1374806016 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e4401c070 con 0x7f5e4c154e60 2024-09-19T05:37:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.917+0000 7f5e48ff9640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5e3806c2b0 0x7f5e3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.917+0000 7f5e48ff9640 1 -- 172.21.15.103:0/1374806016 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f5e4408b1b0 con 0x7f5e4c154e60 2024-09-19T05:37:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.917+0000 7f5e4bfff640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5e3806c2b0 0x7f5e3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.918+0000 7f5e4bfff640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5e3806c2b0 0x7f5e3806e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00b810 tx=0x7f5e3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:44.922+0000 7f5e48ff9640 1 -- 172.21.15.103:0/1374806016 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5e440591a0 con 0x7f5e4c154e60 2024-09-19T05:37:45.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:45.088+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5e4c0ca450 con 0x7f5e4c154e60 2024-09-19T05:37:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.791+0000 7f5e48ff9640 1 -- 172.21.15.103:0/1374806016 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f5e4405d4a0 con 0x7f5e4c154e60 2024-09-19T05:37:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' created 2024-09-19T05:37:46.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5e3806c2b0 msgr2=0x7f5e3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5e3806c2b0 0x7f5e3806e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00b810 tx=0x7f5e3c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c154e60 msgr2=0x7f5e4c157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c154e60 0x7f5e4c157ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400b9c0 tx=0x7f5e4400be80 comp rx=0 tx=0).stop 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 shutdown_connections 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5e3806c2b0 0x7f5e3806e770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e4c154e60 0x7f5e4c157ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e4c0cf3e0 0x7f5e4c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 --2- 172.21.15.103:0/1374806016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5e4c06d260 0x7f5e4c1f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.796+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 >> 172.21.15.103:0/1374806016 conn(0x7f5e4c0ce8c0 msgr2=0x7f5e4c14e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.798+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 shutdown_connections 2024-09-19T05:37:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.799+0000 7f5e5245c640 1 -- 172.21.15.103:0/1374806016 wait complete. 2024-09-19T05:37:46.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T05:37:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.923+0000 7f6c7e474640 1 Processor -- start 2024-09-19T05:37:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.923+0000 7f6c7e474640 1 -- start start 2024-09-19T05:37:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c7e474640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c78152f40 0x7f6c780744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c7e474640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780c5c60 0x7f6c780713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c7e474640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c78159800 con 0x7f6c780c6330 2024-09-19T05:37:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c7e474640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f6c78074010 con 0x7f6c78152f40 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c7e474640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6c780739c0 con 0x7f6c780c5c60 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c77fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c78152f40 0x7f6c780744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c77fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c78152f40 0x7f6c780744a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60106/0 (socket says 172.21.15.103:60106) 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c77fff640 1 -- 172.21.15.103:0/3780847324 learned_addr learned my addr 172.21.15.103:0/3780847324 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c7ca11640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6c780c6330 0x7f6c7806f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46478/0 (socket says 172.21.15.103:46478) 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.924+0000 7f6c777fe640 1 --2- 172.21.15.103:0/3780847324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780c5c60 0x7f6c780713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c77fff640 1 -- 172.21.15.103:0/3780847324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780c5c60 msgr2=0x7f6c780713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c77fff640 1 --2- 172.21.15.103:0/3780847324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780c5c60 0x7f6c780713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c77fff640 1 -- 172.21.15.103:0/3780847324 >> v1:172.21.15.103:6789/0 conn(0x7f6c780c6330 legacy=0x7f6c7806f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c77fff640 1 -- 172.21.15.103:0/3780847324 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c78073ca0 con 0x7f6c78152f40 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c76ffd640 1 -- 172.21.15.103:0/3780847324 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985773516 0 0) 0x7f6c78159800 con 0x7f6c780c6330 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c77fff640 1 --2- 172.21.15.103:0/3780847324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c78152f40 0x7f6c780744a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009870 tx=0x7f6c6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dd3ed0b71c928f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c76ffd640 1 -- 172.21.15.103:0/3780847324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68037070 con 0x7f6c78152f40 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c76ffd640 1 -- 172.21.15.103:0/3780847324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c68032440 con 0x7f6c78152f40 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.925+0000 7f6c76ffd640 1 -- 172.21.15.103:0/3780847324 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68032810 con 0x7f6c78152f40 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 -- 172.21.15.103:0/3780847324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c78152f40 msgr2=0x7f6c780744a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 --2- 172.21.15.103:0/3780847324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c78152f40 0x7f6c780744a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009870 tx=0x7f6c6802a1c0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 -- 172.21.15.103:0/3780847324 shutdown_connections 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 --2- 172.21.15.103:0/3780847324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780c5c60 0x7f6c780713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 --2- 172.21.15.103:0/3780847324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c78152f40 0x7f6c780744a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 -- 172.21.15.103:0/3780847324 >> 172.21.15.103:0/3780847324 conn(0x7f6c7806e9f0 msgr2=0x7f6c7806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 -- 172.21.15.103:0/3780847324 shutdown_connections 2024-09-19T05:37:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.926+0000 7f6c7e474640 1 -- 172.21.15.103:0/3780847324 wait complete. 2024-09-19T05:37:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.927+0000 7f6c7e474640 1 Processor -- start 2024-09-19T05:37:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.927+0000 7f6c7e474640 1 -- start start 2024-09-19T05:37:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c7e474640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c780c5c60 0x7f6c780c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c7e474640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780c6330 0x7f6c781f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c7e474640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c78152f40 0x7f6c781f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c7e474640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78153320 con 0x7f6c780c5c60 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c7e474640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78073190 con 0x7f6c780c6330 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c7e474640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7806ce90 con 0x7f6c78152f40 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c780c5c60 0x7f6c780c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c780c5c60 0x7f6c780c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60118/0 (socket says 172.21.15.103:60118) 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 -- 172.21.15.103:0/2334678408 learned_addr learned my addr 172.21.15.103:0/2334678408 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c777fe640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780c6330 0x7f6c781f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 -- 172.21.15.103:0/2334678408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c78152f40 msgr2=0x7f6c781f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c78152f40 0x7f6c781f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 -- 172.21.15.103:0/2334678408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780c6330 msgr2=0x7f6c781f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780c6330 0x7f6c781f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.928+0000 7f6c77fff640 1 -- 172.21.15.103:0/2334678408 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c781562f0 con 0x7f6c780c5c60 2024-09-19T05:37:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.929+0000 7f6c77fff640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c780c5c60 0x7f6c780c7f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c68000c00 tx=0x7f6c680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.929+0000 7f6c74ff9640 1 -- 172.21.15.103:0/2334678408 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68041020 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.929+0000 7f6c74ff9640 1 -- 172.21.15.103:0/2334678408 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c680306c0 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.929+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7814c6d0 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.929+0000 7f6c74ff9640 1 -- 172.21.15.103:0/2334678408 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68037040 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.929+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7814cc90 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.930+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c78159ae0 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.930+0000 7f6c74ff9640 1 -- 172.21.15.103:0/2334678408 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c68044020 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.931+0000 7f6c74ff9640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6c6406c2b0 0x7f6c6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.931+0000 7f6c74ff9640 1 -- 172.21.15.103:0/2334678408 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f6c680ac020 con 0x7f6c780c5c60 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.931+0000 7f6c777fe640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6c6406c2b0 0x7f6c6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.931+0000 7f6c777fe640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6c6406c2b0 0x7f6c6406e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c780c8ff0 tx=0x7f6c6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:46.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:46.935+0000 7f6c74ff9640 1 -- 172.21.15.103:0/2334678408 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6c6804b030 con 0x7f6c780c5c60 2024-09-19T05:37:47.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.102+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f6c7806df50 con 0x7f6c780c5c60 2024-09-19T05:37:47.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.793+0000 7f6c74ff9640 1 -- 172.21.15.103:0/2334678408 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f6c6807a3e0 con 0x7f6c780c5c60 2024-09-19T05:37:47.796 INFO:teuthology.orchestra.run.smithi103.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T05:37:47.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6c6406c2b0 msgr2=0x7f6c6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:47.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6c6406c2b0 0x7f6c6406e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c780c8ff0 tx=0x7f6c6c008040 comp rx=0 tx=0).stop 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c780c5c60 msgr2=0x7f6c780c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c780c5c60 0x7f6c780c7f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c68000c00 tx=0x7f6c680046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 shutdown_connections 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6c6406c2b0 0x7f6c6406e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c78152f40 0x7f6c781f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780c6330 0x7f6c781f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 --2- 172.21.15.103:0/2334678408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c780c5c60 0x7f6c780c7f00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 >> 172.21.15.103:0/2334678408 conn(0x7f6c7806e9f0 msgr2=0x7f6c7806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.797+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 shutdown_connections 2024-09-19T05:37:47.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.800+0000 7f6c7e474640 1 -- 172.21.15.103:0/2334678408 wait complete. 2024-09-19T05:37:47.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T05:37:47.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.931+0000 7f20aa627640 1 Processor -- start 2024-09-19T05:37:47.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.931+0000 7f20aa627640 1 -- start start 2024-09-19T05:37:47.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.931+0000 7f20aa627640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:47.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.931+0000 7f20aa627640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20a406c260 0x7f20a40c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:47.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.931+0000 7f20aa627640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a4071980 con 0x7f20a40c7ef0 2024-09-19T05:37:47.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.931+0000 7f20aa627640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f20a40c7520 con 0x7f20a406c260 2024-09-19T05:37:47.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.931+0000 7f20aa627640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f20a40c83f0 con 0x7f20a406be80 2024-09-19T05:37:47.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20a406c260 0x7f20a40c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:47.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20a406c260 0x7f20a40c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60132/0 (socket says 172.21.15.103:60132) 2024-09-19T05:37:47.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a37fe640 1 -- 172.21.15.103:0/1953154834 learned_addr learned my addr 172.21.15.103:0/1953154834 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:47.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a37fe640 1 -- 172.21.15.103:0/1953154834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 msgr2=0x7f20a4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:47.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a3fff640 1 --2- 172.21.15.103:0/1953154834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:47.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a37fe640 1 --2- 172.21.15.103:0/1953154834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a37fe640 1 -- 172.21.15.103:0/1953154834 >> v1:172.21.15.174:6789/0 conn(0x7f20a40c7ef0 legacy=0x7f20a4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:47.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.932+0000 7f20a37fe640 1 -- 172.21.15.103:0/1953154834 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a40c8690 con 0x7f20a406c260 2024-09-19T05:37:47.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20a37fe640 1 --2- 172.21.15.103:0/1953154834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a40c79b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2098009870 tx=0x7f209802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356419a7a810dafb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20a2ffd640 1 -- 172.21.15.103:0/1953154834 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098037070 con 0x7f20a406c260 2024-09-19T05:37:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20a2ffd640 1 -- 172.21.15.103:0/1953154834 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098032440 con 0x7f20a406c260 2024-09-19T05:37:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20a2ffd640 1 -- 172.21.15.103:0/1953154834 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098032810 con 0x7f20a406c260 2024-09-19T05:37:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 -- 172.21.15.103:0/1953154834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 msgr2=0x7f20a40c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 --2- 172.21.15.103:0/1953154834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a40c79b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2098009870 tx=0x7f209802a2a0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 -- 172.21.15.103:0/1953154834 shutdown_connections 2024-09-19T05:37:47.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 --2- 172.21.15.103:0/1953154834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a40c79b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 --2- 172.21.15.103:0/1953154834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 -- 172.21.15.103:0/1953154834 >> 172.21.15.103:0/1953154834 conn(0x7f20a406ef90 msgr2=0x7f20a406f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:47.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 -- 172.21.15.103:0/1953154834 shutdown_connections 2024-09-19T05:37:47.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.933+0000 7f20aa627640 1 -- 172.21.15.103:0/1953154834 wait complete. 2024-09-19T05:37:47.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.934+0000 7f20aa627640 1 Processor -- start 2024-09-19T05:37:47.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20aa627640 1 -- start start 2024-09-19T05:37:47.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20aa627640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:47.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20aa627640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a41f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:47.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20aa627640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20a40c7ef0 0x7f20a4157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:47.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20aa627640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20a40c71b0 con 0x7f20a406c260 2024-09-19T05:37:47.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20aa627640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f20a40c8c10 con 0x7f20a40c7ef0 2024-09-19T05:37:47.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20aa627640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f20a40713a0 con 0x7f20a406be80 2024-09-19T05:37:47.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20a37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a41f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:47.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20a37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a41f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60136/0 (socket says 172.21.15.103:60136) 2024-09-19T05:37:47.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.935+0000 7f20a37fe640 1 -- 172.21.15.103:0/2807355564 learned_addr learned my addr 172.21.15.103:0/2807355564 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:47.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a3fff640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:47.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a8bc4640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20a40c7ef0 0x7f20a4157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:47.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a37fe640 1 -- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 msgr2=0x7f20a4155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:47.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a37fe640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a37fe640 1 -- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20a40c7ef0 msgr2=0x7f20a4157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:47.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a37fe640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20a40c7ef0 0x7f20a4157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:47.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a37fe640 1 -- 172.21.15.103:0/2807355564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a4155180 con 0x7f20a406c260 2024-09-19T05:37:47.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a8bc4640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20a40c7ef0 0x7f20a4157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:47.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a37fe640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a41f1f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2098009870 tx=0x7f20980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:47.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a0ff9640 1 -- 172.21.15.103:0/2807355564 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098041020 con 0x7f20a406c260 2024-09-19T05:37:47.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a0ff9640 1 -- 172.21.15.103:0/2807355564 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098030970 con 0x7f20a406c260 2024-09-19T05:37:47.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a41e3140 con 0x7f20a406c260 2024-09-19T05:37:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20a0ff9640 1 -- 172.21.15.103:0/2807355564 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098037040 con 0x7f20a406c260 2024-09-19T05:37:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.936+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a4155420 con 0x7f20a406c260 2024-09-19T05:37:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.937+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a4073730 con 0x7f20a406c260 2024-09-19T05:37:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.937+0000 7f20a0ff9640 1 -- 172.21.15.103:0/2807355564 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2098044020 con 0x7f20a406c260 2024-09-19T05:37:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.938+0000 7f20a0ff9640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f209006c2e0 0x7f209006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.938+0000 7f20a0ff9640 1 -- 172.21.15.103:0/2807355564 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f20980ac0d0 con 0x7f20a406c260 2024-09-19T05:37:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.938+0000 7f20a3fff640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f209006c2e0 0x7f209006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.938+0000 7f20a3fff640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f209006c2e0 0x7f209006e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2094006fd0 tx=0x7f2094008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:47.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:47.942+0000 7f20a0ff9640 1 -- 172.21.15.103:0/2807355564 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f20a4073730 con 0x7f20a406c260 2024-09-19T05:37:48.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.146+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f20a40c3830 con 0x7f20a406c260 2024-09-19T05:37:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.825+0000 7f20a0ff9640 1 -- 172.21.15.103:0/2807355564 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f209804b030 con 0x7f20a406c260 2024-09-19T05:37:48.828 INFO:teuthology.orchestra.run.smithi103.stderr:added data pool 4 to fsmap 2024-09-19T05:37:48.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f209006c2e0 msgr2=0x7f209006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f209006c2e0 0x7f209006e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2094006fd0 tx=0x7f2094008040 comp rx=0 tx=0).stop 2024-09-19T05:37:48.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 msgr2=0x7f20a41f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a41f1f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2098009870 tx=0x7f20980046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 shutdown_connections 2024-09-19T05:37:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f209006c2e0 0x7f209006e7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20a40c7ef0 0x7f20a4157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20a406c260 0x7f20a41f1f10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 --2- 172.21.15.103:0/2807355564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a406be80 0x7f20a4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 >> 172.21.15.103:0/2807355564 conn(0x7f20a406ef90 msgr2=0x7f20a4071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.827+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 shutdown_connections 2024-09-19T05:37:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.828+0000 7f20aa627640 1 -- 172.21.15.103:0/2807355564 wait complete. 2024-09-19T05:37:48.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:48.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.938+0000 7fa4b38ac640 1 Processor -- start 2024-09-19T05:37:48.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.938+0000 7fa4b38ac640 1 -- start start 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b38ac640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4ac1550b0 0x7fa4ac073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b38ac640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac155490 0x7fa4ac0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b38ac640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4ac0c9d00 con 0x7fa4ac06d730 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b38ac640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa4ac15edb0 con 0x7fa4ac1550b0 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b38ac640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ac0ca9b0 con 0x7fa4ac155490 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b1648640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4ac1550b0 0x7fa4ac073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b0e47640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa4ac06d730 0x7fa4ac0ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46490/0 (socket says 172.21.15.103:46490) 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b0e47640 1 -- 172.21.15.103:0/298268317 learned_addr learned my addr 172.21.15.103:0/298268317 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b1648640 1 -- 172.21.15.103:0/298268317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac155490 msgr2=0x7fa4ac0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b1648640 1 --2- 172.21.15.103:0/298268317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac155490 0x7fa4ac0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b1648640 1 -- 172.21.15.103:0/298268317 >> v1:172.21.15.103:6789/0 conn(0x7fa4ac06d730 legacy=0x7fa4ac0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4a3fff640 1 -- 172.21.15.103:0/298268317 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981138057 0 0) 0x7fa4ac0c9d00 con 0x7fa4ac06d730 2024-09-19T05:37:48.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.939+0000 7fa4b1648640 1 -- 172.21.15.103:0/298268317 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac15e4a0 con 0x7fa4ac1550b0 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.940+0000 7fa4b1648640 1 --2- 172.21.15.103:0/298268317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac1550b0 0x7fa4ac073f60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80097a0 tx=0x7fa4a802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2115c141b22f06ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.940+0000 7fa4a3fff640 1 -- 172.21.15.103:0/298268317 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8037070 con 0x7fa4ac1550b0 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.940+0000 7fa4a3fff640 1 -- 172.21.15.103:0/298268317 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8032440 con 0x7fa4ac1550b0 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.940+0000 7fa4a3fff640 1 -- 172.21.15.103:0/298268317 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8032810 con 0x7fa4ac1550b0 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.940+0000 7fa4b38ac640 1 -- 172.21.15.103:0/298268317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac1550b0 msgr2=0x7fa4ac073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.940+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/298268317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac1550b0 0x7fa4ac073f60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80097a0 tx=0x7fa4a802a230 comp rx=0 tx=0).stop 2024-09-19T05:37:48.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.941+0000 7fa4b38ac640 1 -- 172.21.15.103:0/298268317 shutdown_connections 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.941+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/298268317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac155490 0x7fa4ac0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.941+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/298268317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac1550b0 0x7fa4ac073f60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.941+0000 7fa4b38ac640 1 -- 172.21.15.103:0/298268317 >> 172.21.15.103:0/298268317 conn(0x7fa4ac06c240 msgr2=0x7fa4ac067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.941+0000 7fa4b38ac640 1 -- 172.21.15.103:0/298268317 shutdown_connections 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.941+0000 7fa4b38ac640 1 -- 172.21.15.103:0/298268317 wait complete. 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 Processor -- start 2024-09-19T05:37:48.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 -- start start 2024-09-19T05:37:48.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac1550b0 0x7fa4ac14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac155490 0x7fa4ac1f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ac15e080 0x7fa4ac155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac15ea40 con 0x7fa4ac155490 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac15e760 con 0x7fa4ac15e080 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.942+0000 7fa4b38ac640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ac15f240 con 0x7fa4ac1550b0 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac155490 0x7fa4ac1f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac155490 0x7fa4ac1f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60150/0 (socket says 172.21.15.103:60150) 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 -- 172.21.15.103:0/4272050857 learned_addr learned my addr 172.21.15.103:0/4272050857 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b1648640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac1550b0 0x7fa4ac14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b1e49640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ac15e080 0x7fa4ac155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 -- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac1550b0 msgr2=0x7fa4ac14c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac1550b0 0x7fa4ac14c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 -- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ac15e080 msgr2=0x7fa4ac155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ac15e080 0x7fa4ac155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 -- 172.21.15.103:0/4272050857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac1f4d10 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b1648640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac1550b0 0x7fa4ac14c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b1e49640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ac15e080 0x7fa4ac155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b0e47640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac155490 0x7fa4ac1f4250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00c430 tx=0x7fa49c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4a1ffb640 1 -- 172.21.15.103:0/4272050857 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0074e0 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4a1ffb640 1 -- 172.21.15.103:0/4272050857 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c0047e0 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ac0c8420 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4a1ffb640 1 -- 172.21.15.103:0/4272050857 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c004bd0 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.943+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ac1582d0 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.944+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ac074520 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.945+0000 7fa4a1ffb640 1 -- 172.21.15.103:0/4272050857 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa49c011070 con 0x7fa4ac155490 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.945+0000 7fa4a1ffb640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa49006c2b0 0x7fa49006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:48.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.945+0000 7fa4a1ffb640 1 -- 172.21.15.103:0/4272050857 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa49c08b380 con 0x7fa4ac155490 2024-09-19T05:37:48.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.945+0000 7fa4b1648640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa49006c2b0 0x7fa49006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:48.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.946+0000 7fa4b1648640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa49006c2b0 0x7fa49006e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8034000 tx=0x7fa4a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:48.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:48.949+0000 7fa4a1ffb640 1 -- 172.21.15.103:0/4272050857 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa49c059840 con 0x7fa4ac155490 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.150+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4ac0c9710 con 0x7fa4ac155490 2024-09-19T05:37:49.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.151+0000 7fa4a1ffb640 1 -- 172.21.15.103:0/4272050857 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6879 (secure 0 0 0) 0x7fa49c059140 con 0x7fa4ac155490 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"btime":"2024-09-19T05:37:48:829069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:37:48.820708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-09-19T05:37:49.154 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa49006c2b0 msgr2=0x7fa49006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa49006c2b0 0x7fa49006e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8034000 tx=0x7fa4a802e000 comp rx=0 tx=0).stop 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac155490 msgr2=0x7fa4ac1f4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac155490 0x7fa4ac1f4250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00c430 tx=0x7fa49c00c8f0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 shutdown_connections 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa49006c2b0 0x7fa49006e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ac15e080 0x7fa4ac155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ac155490 0x7fa4ac1f4250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 --2- 172.21.15.103:0/4272050857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4ac1550b0 0x7fa4ac14c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 >> 172.21.15.103:0/4272050857 conn(0x7fa4ac06c240 msgr2=0x7fa4ac14fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 shutdown_connections 2024-09-19T05:37:49.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.153+0000 7fa4b38ac640 1 -- 172.21.15.103:0/4272050857 wait complete. 2024-09-19T05:37:49.166 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:49.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.261+0000 7f8473e23640 1 Processor -- start 2024-09-19T05:37:49.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.261+0000 7f8473e23640 1 -- start start 2024-09-19T05:37:49.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f8473e23640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f8473e23640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f846c155320 0x7f846c0cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f8473e23640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846c0cb830 con 0x7f846c15ed80 2024-09-19T05:37:49.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f8473e23640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f846c15f1c0 con 0x7f846c155320 2024-09-19T05:37:49.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f8473e23640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f846c0cbb10 con 0x7f846c154f40 2024-09-19T05:37:49.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f8471bbf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f84713be640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f846c155320 0x7f846c0cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f84723c0640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f846c15ed80 0x7f846c0d0b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:53512/0 (socket says 172.21.15.103:53512) 2024-09-19T05:37:49.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.262+0000 7f84723c0640 1 -- 172.21.15.103:0/2384121160 learned_addr learned my addr 172.21.15.103:0/2384121160 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:49.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.263+0000 7f8471bbf640 1 -- 172.21.15.103:0/2384121160 >> v2:172.21.15.174:3300/0 conn(0x7f846c155320 msgr2=0x7f846c0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:49.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.263+0000 7f8471bbf640 1 --2- 172.21.15.103:0/2384121160 >> v2:172.21.15.174:3300/0 conn(0x7f846c155320 0x7f846c0cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.263+0000 7f8471bbf640 1 -- 172.21.15.103:0/2384121160 >> v1:172.21.15.174:6789/0 conn(0x7f846c15ed80 legacy=0x7f846c0d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.263+0000 7f8471bbf640 1 -- 172.21.15.103:0/2384121160 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c0cbdf0 con 0x7f846c154f40 2024-09-19T05:37:49.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8471bbf640 1 --2- 172.21.15.103:0/2384121160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c0c75b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84680097a0 tx=0x7f846802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=206c650cd70b3fab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8470bbd640 1 -- 172.21.15.103:0/2384121160 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468037070 con 0x7f846c154f40 2024-09-19T05:37:49.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8470bbd640 1 -- 172.21.15.103:0/2384121160 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8468032440 con 0x7f846c154f40 2024-09-19T05:37:49.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8470bbd640 1 -- 172.21.15.103:0/2384121160 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468032810 con 0x7f846c154f40 2024-09-19T05:37:49.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 -- 172.21.15.103:0/2384121160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 msgr2=0x7f846c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 --2- 172.21.15.103:0/2384121160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c0c75b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84680097a0 tx=0x7f846802a180 comp rx=0 tx=0).stop 2024-09-19T05:37:49.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 -- 172.21.15.103:0/2384121160 shutdown_connections 2024-09-19T05:37:49.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 --2- 172.21.15.103:0/2384121160 >> v2:172.21.15.174:3300/0 conn(0x7f846c155320 0x7f846c0cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 --2- 172.21.15.103:0/2384121160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c0c75b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 -- 172.21.15.103:0/2384121160 >> 172.21.15.103:0/2384121160 conn(0x7f846c06bc10 msgr2=0x7f846c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 -- 172.21.15.103:0/2384121160 shutdown_connections 2024-09-19T05:37:49.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.264+0000 7f8473e23640 1 -- 172.21.15.103:0/2384121160 wait complete. 2024-09-19T05:37:49.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.265+0000 7f8473e23640 1 Processor -- start 2024-09-19T05:37:49.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8473e23640 1 -- start start 2024-09-19T05:37:49.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8473e23640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8473e23640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f846c15ed80 0x7f846c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8473e23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f846c157d60 0x7f846c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8473e23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f846c0d12a0 con 0x7f846c157d60 2024-09-19T05:37:49.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8473e23640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f846c0742c0 con 0x7f846c15ed80 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8473e23640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f846c0d1420 con 0x7f846c154f40 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f84723c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f846c157d60 0x7f846c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f84723c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f846c157d60 0x7f846c158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60158/0 (socket says 172.21.15.103:60158) 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f84723c0640 1 -- 172.21.15.103:0/2155132572 learned_addr learned my addr 172.21.15.103:0/2155132572 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f84713be640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f846c15ed80 0x7f846c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.266+0000 7f8471bbf640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84723c0640 1 -- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 msgr2=0x7f846c15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84723c0640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c15b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84723c0640 1 -- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f846c15ed80 msgr2=0x7f846c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84723c0640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f846c15ed80 0x7f846c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84723c0640 1 -- 172.21.15.103:0/2155132572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c1f0bd0 con 0x7f846c157d60 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f8471bbf640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84723c0640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f846c157d60 0x7f846c158a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f846400cbc0 tx=0x7f846400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84627fc640 1 -- 172.21.15.103:0/2155132572 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464017070 con 0x7f846c157d60 2024-09-19T05:37:49.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84627fc640 1 -- 172.21.15.103:0/2155132572 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846400ace0 con 0x7f846c157d60 2024-09-19T05:37:49.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846c159e10 con 0x7f846c157d60 2024-09-19T05:37:49.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f84627fc640 1 -- 172.21.15.103:0/2155132572 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464012600 con 0x7f846c157d60 2024-09-19T05:37:49.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.267+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846c15a3d0 con 0x7f846c157d60 2024-09-19T05:37:49.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.268+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846c15aba0 con 0x7f846c157d60 2024-09-19T05:37:49.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.268+0000 7f84627fc640 1 -- 172.21.15.103:0/2155132572 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f846401a070 con 0x7f846c157d60 2024-09-19T05:37:49.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.269+0000 7f84627fc640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f845006c2b0 0x7f845006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.269+0000 7f8471bbf640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f845006c2b0 0x7f845006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.269+0000 7f84627fc640 1 -- 172.21.15.103:0/2155132572 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f846408b390 con 0x7f846c157d60 2024-09-19T05:37:49.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.269+0000 7f8471bbf640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f845006c2b0 0x7f845006e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8468034000 tx=0x7f846802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.273+0000 7f84627fc640 1 -- 172.21.15.103:0/2155132572 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8464059180 con 0x7f846c157d60 2024-09-19T05:37:49.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.440+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f846c0cb1c0 con 0x7f846c157d60 2024-09-19T05:37:49.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.441+0000 7f84627fc640 1 -- 172.21.15.103:0/2155132572 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18683 (secure 0 0 0) 0x7f846405d480 con 0x7f846c157d60 2024-09-19T05:37:49.444 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:49.444 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:48.148558+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:49.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f845006c2b0 msgr2=0x7f845006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f845006c2b0 0x7f845006e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8468034000 tx=0x7f846802e000 comp rx=0 tx=0).stop 2024-09-19T05:37:49.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f846c157d60 msgr2=0x7f846c158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f846c157d60 0x7f846c158a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f846400cbc0 tx=0x7f846400a430 comp rx=0 tx=0).stop 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 shutdown_connections 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f845006c2b0 0x7f845006e770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f846c157d60 0x7f846c158a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f846c15ed80 0x7f846c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 --2- 172.21.15.103:0/2155132572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f846c154f40 0x7f846c15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 >> 172.21.15.103:0/2155132572 conn(0x7f846c06bc10 msgr2=0x7f846c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 shutdown_connections 2024-09-19T05:37:49.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.443+0000 7f8473e23640 1 -- 172.21.15.103:0/2155132572 wait complete. 2024-09-19T05:37:49.456 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.552+0000 7f1782149640 1 Processor -- start 2024-09-19T05:37:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.552+0000 7f1782149640 1 -- start start 2024-09-19T05:37:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f1782149640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f177c06d730 0x7f177c073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f1782149640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f177c155490 0x7f177c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f1782149640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f177c0c9d00 con 0x7f177c1550b0 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f1782149640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f177c15edb0 con 0x7f177c155490 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f1782149640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f177c0ca9b0 con 0x7f177c06d730 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f177c155490 0x7f177c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f177c1550b0 0x7f177c0ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46496/0 (socket says 172.21.15.103:46496) 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f177c155490 0x7f177c0ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60174/0 (socket says 172.21.15.103:60174) 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177b7fe640 1 -- 172.21.15.103:0/1370888046 learned_addr learned my addr 172.21.15.103:0/1370888046 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177affd640 1 --2- 172.21.15.103:0/1370888046 >> v2:172.21.15.174:3300/0 conn(0x7f177c06d730 0x7f177c073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177bfff640 1 -- 172.21.15.103:0/1370888046 >> v2:172.21.15.174:3300/0 conn(0x7f177c06d730 msgr2=0x7f177c073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177bfff640 1 --2- 172.21.15.103:0/1370888046 >> v2:172.21.15.174:3300/0 conn(0x7f177c06d730 0x7f177c073f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177bfff640 1 -- 172.21.15.103:0/1370888046 >> v1:172.21.15.103:6789/0 conn(0x7f177c1550b0 legacy=0x7f177c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177a7fc640 1 -- 172.21.15.103:0/1370888046 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428633962 0 0) 0x7f177c0c9d00 con 0x7f177c1550b0 2024-09-19T05:37:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.553+0000 7f177bfff640 1 -- 172.21.15.103:0/1370888046 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c15e4a0 con 0x7f177c155490 2024-09-19T05:37:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.554+0000 7f177bfff640 1 --2- 172.21.15.103:0/1370888046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c0ce6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f177c0cc620 tx=0x7f177402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73d0534b1506978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.554+0000 7f177a7fc640 1 -- 172.21.15.103:0/1370888046 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774037070 con 0x7f177c155490 2024-09-19T05:37:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.554+0000 7f177a7fc640 1 -- 172.21.15.103:0/1370888046 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1774032440 con 0x7f177c155490 2024-09-19T05:37:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.554+0000 7f177a7fc640 1 -- 172.21.15.103:0/1370888046 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774032810 con 0x7f177c155490 2024-09-19T05:37:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 -- 172.21.15.103:0/1370888046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 msgr2=0x7f177c0ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 --2- 172.21.15.103:0/1370888046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c0ce6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f177c0cc620 tx=0x7f177402a230 comp rx=0 tx=0).stop 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 -- 172.21.15.103:0/1370888046 shutdown_connections 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 --2- 172.21.15.103:0/1370888046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c0ce6a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 --2- 172.21.15.103:0/1370888046 >> v2:172.21.15.174:3300/0 conn(0x7f177c06d730 0x7f177c073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 -- 172.21.15.103:0/1370888046 >> 172.21.15.103:0/1370888046 conn(0x7f177c06c240 msgr2=0x7f177c067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 -- 172.21.15.103:0/1370888046 shutdown_connections 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.555+0000 7f1782149640 1 -- 172.21.15.103:0/1370888046 wait complete. 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.556+0000 7f1782149640 1 Processor -- start 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.556+0000 7f1782149640 1 -- start start 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f1782149640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f177c1550b0 0x7f177c1f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f1782149640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c1e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f1782149640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f177c1575f0 0x7f177c1f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f1782149640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f177c15ea40 con 0x7f177c155490 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f1782149640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f177c15e760 con 0x7f177c1575f0 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f1782149640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f177c15f240 con 0x7f177c1550b0 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c1e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c1e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60188/0 (socket says 172.21.15.103:60188) 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 -- 172.21.15.103:0/241967778 learned_addr learned my addr 172.21.15.103:0/241967778 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177b7fe640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f177c1550b0 0x7f177c1f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177bfff640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f177c1575f0 0x7f177c1f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 -- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f177c1550b0 msgr2=0x7f177c1f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f177c1550b0 0x7f177c1f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 -- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f177c1575f0 msgr2=0x7f177c1f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f177c1575f0 0x7f177c1f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 -- 172.21.15.103:0/241967778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c15e250 con 0x7f177c155490 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177b7fe640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f177c1550b0 0x7f177c1f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.557+0000 7f177affd640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c1e6a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f177000c7f0 tx=0x7f177000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.558+0000 7f1763fff640 1 -- 172.21.15.103:0/241967778 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1770015070 con 0x7f177c155490 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.558+0000 7f1763fff640 1 -- 172.21.15.103:0/241967778 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1770004220 con 0x7f177c155490 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.558+0000 7f1763fff640 1 -- 172.21.15.103:0/241967778 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1770003610 con 0x7f177c155490 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.558+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177c15df70 con 0x7f177c155490 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.558+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177c158530 con 0x7f177c155490 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.559+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177c074520 con 0x7f177c155490 2024-09-19T05:37:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.559+0000 7f1763fff640 1 -- 172.21.15.103:0/241967778 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f17700039c0 con 0x7f177c155490 2024-09-19T05:37:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.559+0000 7f1763fff640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f176806c2e0 0x7f176806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.560+0000 7f177b7fe640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f176806c2e0 0x7f176806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.560+0000 7f1763fff640 1 -- 172.21.15.103:0/241967778 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f177008b630 con 0x7f177c155490 2024-09-19T05:37:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.560+0000 7f177b7fe640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f176806c2e0 0x7f176806e7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f176c0012e0 tx=0x7f176c007f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.564+0000 7f1763fff640 1 -- 172.21.15.103:0/241967778 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1770059410 con 0x7f177c155490 2024-09-19T05:37:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.730+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f177c0c9710 con 0x7f177c155490 2024-09-19T05:37:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.731+0000 7f1763fff640 1 -- 172.21.15.103:0/241967778 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18683 (secure 0 0 0) 0x7f177005d710 con 0x7f177c155490 2024-09-19T05:37:49.734 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:49.734 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:48.148558+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:49.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f176806c2e0 msgr2=0x7f176806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f176806c2e0 0x7f176806e7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f176c0012e0 tx=0x7f176c007f90 comp rx=0 tx=0).stop 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 msgr2=0x7f177c1e6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c1e6a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f177000c7f0 tx=0x7f177000ccb0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 shutdown_connections 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f176806c2e0 0x7f176806e7a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f177c1575f0 0x7f177c1f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f177c155490 0x7f177c1e6a50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 --2- 172.21.15.103:0/241967778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f177c1550b0 0x7f177c1f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 >> 172.21.15.103:0/241967778 conn(0x7f177c06c240 msgr2=0x7f177c153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 shutdown_connections 2024-09-19T05:37:49.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.734+0000 7f1782149640 1 -- 172.21.15.103:0/241967778 wait complete. 2024-09-19T05:37:49.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:37:49.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.861+0000 7fa76d43c640 1 Processor -- start 2024-09-19T05:37:49.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.861+0000 7fa76d43c640 1 -- start start 2024-09-19T05:37:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.861+0000 7fa76d43c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7681530a0 0x7fa76815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.861+0000 7fa76d43c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76815cfc0 con 0x7fa76815cbb0 2024-09-19T05:37:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.861+0000 7fa76d43c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7680c8a90 con 0x7fa768152cc0 2024-09-19T05:37:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.861+0000 7fa76d43c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa7680cf570 con 0x7fa7681530a0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.861+0000 7fa7667fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7681530a0 0x7fa76815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.862+0000 7fa7677fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa76815cbb0 0x7fa7680c5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46502/0 (socket says 172.21.15.103:46502) 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.862+0000 7fa7677fe640 1 -- 172.21.15.103:0/2588960220 learned_addr learned my addr 172.21.15.103:0/2588960220 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.862+0000 7fa7667fc640 1 -- 172.21.15.103:0/2588960220 >> v1:172.21.15.174:6789/0 conn(0x7fa768152cc0 legacy=0x7fa768071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.862+0000 7fa765ffb640 1 -- 172.21.15.103:0/2588960220 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091596833 0 0) 0x7fa760001490 con 0x7fa76815cbb0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.862+0000 7fa7667fc640 1 -- 172.21.15.103:0/2588960220 >> v1:172.21.15.103:6789/0 conn(0x7fa76815cbb0 legacy=0x7fa7680c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.862+0000 7fa7667fc640 1 -- 172.21.15.103:0/2588960220 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7680c7f10 con 0x7fa7681530a0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.862+0000 7fa7667fc640 1 --2- 172.21.15.103:0/2588960220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa76815c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0097a0 tx=0x7fa75c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2b5b197e27b7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa765ffb640 1 -- 172.21.15.103:0/2588960220 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c037070 con 0x7fa7681530a0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa765ffb640 1 -- 172.21.15.103:0/2588960220 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c032640 con 0x7fa7681530a0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa765ffb640 1 -- 172.21.15.103:0/2588960220 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c032a10 con 0x7fa7681530a0 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa76d43c640 1 -- 172.21.15.103:0/2588960220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 msgr2=0x7fa76815c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa76d43c640 1 --2- 172.21.15.103:0/2588960220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa76815c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0097a0 tx=0x7fa75c02a2c0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa76d43c640 1 -- 172.21.15.103:0/2588960220 shutdown_connections 2024-09-19T05:37:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa76d43c640 1 --2- 172.21.15.103:0/2588960220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa76815c670 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa76d43c640 1 -- 172.21.15.103:0/2588960220 >> 172.21.15.103:0/2588960220 conn(0x7fa76806f910 msgr2=0x7fa7680735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa76d43c640 1 -- 172.21.15.103:0/2588960220 shutdown_connections 2024-09-19T05:37:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.863+0000 7fa76d43c640 1 -- 172.21.15.103:0/2588960220 wait complete. 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 Processor -- start 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 -- start start 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa768152cc0 0x7fa7681e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa7681472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa76815cbb0 0x7fa7681e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa7680c87b0 con 0x7fa7681530a0 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa7680c84d0 con 0x7fa768152cc0 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa76d43c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa76815c150 con 0x7fa76815cbb0 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa7667fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa7681472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa7667fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa7681472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60200/0 (socket says 172.21.15.103:60200) 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa7667fc640 1 -- 172.21.15.103:0/966434644 learned_addr learned my addr 172.21.15.103:0/966434644 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.865+0000 7fa766ffd640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa768152cc0 0x7fa7681e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa7677fe640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa76815cbb0 0x7fa7681e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa7667fc640 1 -- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa76815cbb0 msgr2=0x7fa7681e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa7667fc640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa76815cbb0 0x7fa7681e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa7667fc640 1 -- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa768152cc0 msgr2=0x7fa7681e1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa7667fc640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa768152cc0 0x7fa7681e1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa7667fc640 1 -- 172.21.15.103:0/966434644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa768151dd0 con 0x7fa7681530a0 2024-09-19T05:37:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa7667fc640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa7681472d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098c0 tx=0x7fa75c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa74f7fe640 1 -- 172.21.15.103:0/966434644 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c041020 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa74f7fe640 1 -- 172.21.15.103:0/966434644 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c030970 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa768152090 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa74f7fe640 1 -- 172.21.15.103:0/966434644 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c037040 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.866+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7681e3e60 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.867+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7680c7b90 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.867+0000 7fa74f7fe640 1 -- 172.21.15.103:0/966434644 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa75c044020 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.868+0000 7fa74f7fe640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa75406c2b0 0x7fa75406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.868+0000 7fa74f7fe640 1 -- 172.21.15.103:0/966434644 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa75c0abf30 con 0x7fa7681530a0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.868+0000 7fa766ffd640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa75406c2b0 0x7fa75406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.868+0000 7fa766ffd640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa75406c2b0 0x7fa75406e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa758000f60 tx=0x7fa758009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:49.872+0000 7fa74f7fe640 1 -- 172.21.15.103:0/966434644 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa75c04b030 con 0x7fa7681530a0 2024-09-19T05:37:50.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.071+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa768069380 con 0x7fa7681530a0 2024-09-19T05:37:50.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.072+0000 7fa74f7fe640 1 -- 172.21.15.103:0/966434644 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6879 (secure 0 0 0) 0x7fa75c079d10 con 0x7fa7681530a0 2024-09-19T05:37:50.074 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:50.074 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"btime":"2024-09-19T05:37:48:829069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:37:48.820708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-09-19T05:37:50.075 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa75406c2b0 msgr2=0x7fa75406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa75406c2b0 0x7fa75406e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa758000f60 tx=0x7fa758009040 comp rx=0 tx=0).stop 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 msgr2=0x7fa7681472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa7681472d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098c0 tx=0x7fa75c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 shutdown_connections 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa75406c2b0 0x7fa75406e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa76815cbb0 0x7fa7681e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7681530a0 0x7fa7681472d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 --2- 172.21.15.103:0/966434644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa768152cc0 0x7fa7681e1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 >> 172.21.15.103:0/966434644 conn(0x7fa76806f910 msgr2=0x7fa7680cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:50.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 shutdown_connections 2024-09-19T05:37:50.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.074+0000 7fa76d43c640 1 -- 172.21.15.103:0/966434644 wait complete. 2024-09-19T05:37:50.088 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:37:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.184+0000 7f94b539f640 1 Processor -- start 2024-09-19T05:37:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.184+0000 7f94b539f640 1 -- start start 2024-09-19T05:37:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94b539f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 0x7f94b00cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94b539f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b00cbed0 con 0x7f94b00b3540 2024-09-19T05:37:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94b539f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b015bd70 con 0x7f94b00c5950 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94b539f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f94b00cbbf0 con 0x7f94b0155040 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94ae7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f94b00b3540 0x7f94b015e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46504/0 (socket says 172.21.15.103:46504) 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94ae7fc640 1 -- 172.21.15.103:0/3022620740 learned_addr learned my addr 172.21.15.103:0/3022620740 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587688684 0 0) 0x7f94b00cbed0 con 0x7f94b00b3540 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f949c003520 con 0x7f94b00b3540 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94aeffd640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 0x7f94b00cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3885767490 0 0) 0x7f949c003520 con 0x7f94b00b3540 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 msgr2=0x7f94b00cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 0x7f94b00cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 >> v1:172.21.15.174:6789/0 conn(0x7f94b00c5950 legacy=0x7f94b00cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b015afb0 con 0x7f94b00b3540 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.185+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f9498001670 con 0x7f94b00b3540 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 >> v1:172.21.15.103:6789/0 conn(0x7f94b00b3540 legacy=0x7f94b015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94adffb640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f949c0039e0 0x7f949c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94adffb640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c004800 0x7f949c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94adffb640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 0x7f949c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f94b00cbbf0 con 0x7f949c0039e0 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f949c00ba70 con 0x7f949c004800 2024-09-19T05:37:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f949c00bc70 con 0x7f94b0155040 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94aeffd640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f949c0039e0 0x7f949c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94ae7fc640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c004800 0x7f949c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94af7fe640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 0x7f949c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94aeffd640 1 -- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 msgr2=0x7f949c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94aeffd640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0155040 0x7f949c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94aeffd640 1 -- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c004800 msgr2=0x7f949c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94aeffd640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c004800 0x7f949c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.186+0000 7f94aeffd640 1 -- 172.21.15.103:0/3022620740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c003520 con 0x7f949c0039e0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94aeffd640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f949c0039e0 0x7f949c003e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009f90 tx=0x7f949c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ef35d82bb68251 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0009c10 con 0x7f949c0039e0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a0036070 con 0x7f949c0039e0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94adffb640 1 -- 172.21.15.103:0/3022620740 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0031830 con 0x7f949c0039e0 2024-09-19T05:37:50.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94b539f640 1 -- 172.21.15.103:0/3022620740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f949c0039e0 msgr2=0x7f949c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94b539f640 1 --2- 172.21.15.103:0/3022620740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f949c0039e0 0x7f949c003e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009f90 tx=0x7f949c005830 comp rx=0 tx=0).stop 2024-09-19T05:37:50.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94af7fe640 1 -- 172.21.15.103:0/3022620740 reap_dead start 2024-09-19T05:37:50.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94b539f640 1 -- 172.21.15.103:0/3022620740 shutdown_connections 2024-09-19T05:37:50.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94b539f640 1 -- 172.21.15.103:0/3022620740 >> 172.21.15.103:0/3022620740 conn(0x7f94b0073340 msgr2=0x7f94b0073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:50.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94b539f640 1 -- 172.21.15.103:0/3022620740 shutdown_connections 2024-09-19T05:37:50.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.187+0000 7f94b539f640 1 -- 172.21.15.103:0/3022620740 wait complete. 2024-09-19T05:37:50.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 Processor -- start 2024-09-19T05:37:50.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 -- start start 2024-09-19T05:37:50.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c0039e0 0x7f94b0150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0157ef0 0x7f94b00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94b01f45d0 0x7f94b014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f94b015b850 con 0x7f94b01f45d0 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f94b015b570 con 0x7f949c0039e0 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94b539f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f94b015eb30 con 0x7f94b0157ef0 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.189+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94b01f45d0 0x7f94b014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94b01f45d0 0x7f94b014e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60224/0 (socket says 172.21.15.103:60224) 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 -- 172.21.15.103:0/2359372585 learned_addr learned my addr 172.21.15.103:0/2359372585 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94ae7fc640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0157ef0 0x7f94b00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94aeffd640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c0039e0 0x7f94b0150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 -- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0157ef0 msgr2=0x7f94b00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0157ef0 0x7f94b00cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 -- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c0039e0 msgr2=0x7f94b0150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c0039e0 0x7f94b0150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 -- 172.21.15.103:0/2359372585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b006c320 con 0x7f94b01f45d0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94af7fe640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94b01f45d0 0x7f94b014e1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94a800f490 tx=0x7f94a800f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94a77fe640 1 -- 172.21.15.103:0/2359372585 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a80053a0 con 0x7f94b01f45d0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94a77fe640 1 -- 172.21.15.103:0/2359372585 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a8018070 con 0x7f94b01f45d0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b0155720 con 0x7f94b01f45d0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94a77fe640 1 -- 172.21.15.103:0/2359372585 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8003830 con 0x7f94b01f45d0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.190+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b015abf0 con 0x7f94b01f45d0 2024-09-19T05:37:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.191+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b0069810 con 0x7f94b01f45d0 2024-09-19T05:37:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.192+0000 7f94a77fe640 1 -- 172.21.15.103:0/2359372585 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f94a80039d0 con 0x7f94b01f45d0 2024-09-19T05:37:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.192+0000 7f94a77fe640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f949006c2e0 0x7f949006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.192+0000 7f94aeffd640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f949006c2e0 0x7f949006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.192+0000 7f94a77fe640 1 -- 172.21.15.103:0/2359372585 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f94a808b150 con 0x7f94b01f45d0 2024-09-19T05:37:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.193+0000 7f94aeffd640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f949006c2e0 0x7f949006e7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94a0035000 tx=0x7f94a002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.197+0000 7f94a77fe640 1 -- 172.21.15.103:0/2359372585 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f94b0069810 con 0x7f94b01f45d0 2024-09-19T05:37:50.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.365+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94b00cb540 con 0x7f94b01f45d0 2024-09-19T05:37:50.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.366+0000 7f94a77fe640 1 -- 172.21.15.103:0/2359372585 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18670 (secure 0 0 0) 0x7f94a8058f30 con 0x7f94b01f45d0 2024-09-19T05:37:50.369 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:50.369 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:49.821955+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:37:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f949006c2e0 msgr2=0x7f949006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f949006c2e0 0x7f949006e7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94a0035000 tx=0x7f94a002f000 comp rx=0 tx=0).stop 2024-09-19T05:37:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94b01f45d0 msgr2=0x7f94b014e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94b01f45d0 0x7f94b014e1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94a800f490 tx=0x7f94a800f950 comp rx=0 tx=0).stop 2024-09-19T05:37:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 shutdown_connections 2024-09-19T05:37:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f949006c2e0 0x7f949006e7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94b01f45d0 0x7f94b014e1a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94b0157ef0 0x7f94b00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 --2- 172.21.15.103:0/2359372585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f949c0039e0 0x7f94b0150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.368+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 >> 172.21.15.103:0/2359372585 conn(0x7f94b0073340 msgr2=0x7f94b0151cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.369+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 shutdown_connections 2024-09-19T05:37:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:50.369+0000 7f94b539f640 1 -- 172.21.15.103:0/2359372585 wait complete. 2024-09-19T05:37:50.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:43.118180+0000', 'modified': '2024-09-19T05:37:48.820708+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6839/2567820767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 2567820767}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 2567820767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4302, 'qdb_cluster': [4302]} 2024-09-19T05:37:50.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:37:50.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-19T05:37:51.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.086+0000 7fd77cf11640 1 Processor -- start 2024-09-19T05:37:51.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.086+0000 7fd77cf11640 1 -- start start 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd77cf11640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd778151ea0 0x7fd7780c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd77cf11640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7780c3a50 0x7fd77806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd77cf11640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77815bc80 con 0x7fd7780c46c0 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd77cf11640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd7781585a0 con 0x7fd7780c3a50 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd77cf11640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fd778157c70 con 0x7fd778151ea0 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd776d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7780c3a50 0x7fd77806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd776d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7780c3a50 0x7fd77806eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60238/0 (socket says 172.21.15.103:60238) 2024-09-19T05:37:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd776d9d640 1 -- 172.21.15.103:0/3085682441 learned_addr learned my addr 172.21.15.103:0/3085682441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd776d9d640 1 -- 172.21.15.103:0/3085682441 >> v2:172.21.15.174:3300/0 conn(0x7fd778151ea0 msgr2=0x7fd7780c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd776d9d640 1 --2- 172.21.15.103:0/3085682441 >> v2:172.21.15.174:3300/0 conn(0x7fd778151ea0 0x7fd7780c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd776d9d640 1 -- 172.21.15.103:0/3085682441 >> v1:172.21.15.174:6789/0 conn(0x7fd7780c46c0 legacy=0x7fd778158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.087+0000 7fd776d9d640 1 -- 172.21.15.103:0/3085682441 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd778157f50 con 0x7fd7780c3a50 2024-09-19T05:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.088+0000 7fd776d9d640 1 --2- 172.21.15.103:0/3085682441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7780c3a50 0x7fd77806eed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd77806fd40 tx=0x7fd77002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26035c02350e48de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.088+0000 7fd77559a640 1 -- 172.21.15.103:0/3085682441 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770036070 con 0x7fd7780c3a50 2024-09-19T05:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.088+0000 7fd77559a640 1 -- 172.21.15.103:0/3085682441 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd770031600 con 0x7fd7780c3a50 2024-09-19T05:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.088+0000 7fd77559a640 1 -- 172.21.15.103:0/3085682441 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700319d0 con 0x7fd7780c3a50 2024-09-19T05:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 -- 172.21.15.103:0/3085682441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7780c3a50 msgr2=0x7fd77806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 --2- 172.21.15.103:0/3085682441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7780c3a50 0x7fd77806eed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd77806fd40 tx=0x7fd77002a780 comp rx=0 tx=0).stop 2024-09-19T05:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 -- 172.21.15.103:0/3085682441 shutdown_connections 2024-09-19T05:37:51.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 --2- 172.21.15.103:0/3085682441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7780c3a50 0x7fd77806eed0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 --2- 172.21.15.103:0/3085682441 >> v2:172.21.15.174:3300/0 conn(0x7fd778151ea0 0x7fd7780c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 -- 172.21.15.103:0/3085682441 >> 172.21.15.103:0/3085682441 conn(0x7fd7780c9230 msgr2=0x7fd7780c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:51.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 -- 172.21.15.103:0/3085682441 shutdown_connections 2024-09-19T05:37:51.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.089+0000 7fd77cf11640 1 -- 172.21.15.103:0/3085682441 wait complete. 2024-09-19T05:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.090+0000 7fd77cf11640 1 Processor -- start 2024-09-19T05:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.090+0000 7fd77cf11640 1 -- start start 2024-09-19T05:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd77cf11640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7780c3a50 0x7fd77814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd77cf11640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7780c46c0 0x7fd77814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd77cf11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd778151ea0 0x7fd77806be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd77cf11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7781596e0 con 0x7fd778151ea0 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd77cf11640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd778152280 con 0x7fd7780c3a50 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd77cf11640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd778158a30 con 0x7fd7780c46c0 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd778151ea0 0x7fd77806be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd778151ea0 0x7fd77806be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60246/0 (socket says 172.21.15.103:60246) 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 -- 172.21.15.103:0/2149502970 learned_addr learned my addr 172.21.15.103:0/2149502970 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd77659c640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7780c3a50 0x7fd77814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7780c46c0 0x7fd77814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 -- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7780c46c0 msgr2=0x7fd77814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7780c46c0 0x7fd77814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 -- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7780c3a50 msgr2=0x7fd77814d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7780c3a50 0x7fd77814d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 -- 172.21.15.103:0/2149502970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77814e520 con 0x7fd778151ea0 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7780c46c0 0x7fd77814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.091+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd778151ea0 0x7fd77806be80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd770034040 tx=0x7fd770004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.092+0000 7fd766ffd640 1 -- 172.21.15.103:0/2149502970 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770041020 con 0x7fd778151ea0 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.092+0000 7fd766ffd640 1 -- 172.21.15.103:0/2149502970 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7700077a0 con 0x7fd778151ea0 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.092+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77814e7f0 con 0x7fd778151ea0 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.092+0000 7fd766ffd640 1 -- 172.21.15.103:0/2149502970 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770036040 con 0x7fd778151ea0 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.092+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7781efd70 con 0x7fd778151ea0 2024-09-19T05:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.093+0000 7fd766ffd640 1 -- 172.21.15.103:0/2149502970 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd770044020 con 0x7fd778151ea0 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.093+0000 7fd766ffd640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd75806c2b0 0x7fd75806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.094+0000 7fd766ffd640 1 -- 172.21.15.103:0/2149502970 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd7700ac5b0 con 0x7fd778151ea0 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.094+0000 7fd77659c640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd75806c2b0 0x7fd75806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.094+0000 7fd77659c640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd75806c2b0 0x7fd75806e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd76800b810 tx=0x7fd768008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 Processor -- start 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 -- start start 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc84bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fcd64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcd6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b25fbeb520 con 0x55b25fc8ab30 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b25fb933e0 con 0x55b25fc87f80 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.095+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55b25fbe74e0 con 0x55b25fc8a750 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcd6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcd6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60254/0 (socket says 172.21.15.103:60254) 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 -- 172.21.15.103:0/2793287100 learned_addr learned my addr 172.21.15.103:0/2793287100 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fcd64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd77659c640 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc84bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 -- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 msgr2=0x55b25fc84bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc84bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 -- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 msgr2=0x55b25fcd64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fcd64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 -- 172.21.15.103:0/2793287100 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25fbae2f0 con 0x55b25fc8ab30 2024-09-19T05:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcd6a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd770082a20 tx=0x7fd770079e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3711c04e008abfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd757fff640 1 -- 172.21.15.103:0/2793287100 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77007a370 con 0x55b25fc8ab30 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd757fff640 1 -- 172.21.15.103:0/2793287100 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77007e720 con 0x55b25fc8ab30 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.096+0000 7fd757fff640 1 -- 172.21.15.103:0/2793287100 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770082f50 con 0x55b25fc8ab30 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 -- 172.21.15.103:0/2793287100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 msgr2=0x55b25fcd6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcd6a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd770082a20 tx=0x7fd770079e00 comp rx=0 tx=0).stop 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 -- 172.21.15.103:0/2793287100 shutdown_connections 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcd6a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fcd64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2793287100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc84bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 -- 172.21.15.103:0/2793287100 >> 172.21.15.103:0/2793287100 conn(0x55b25fc88e70 msgr2=0x55b25fc89270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 -- 172.21.15.103:0/2793287100 shutdown_connections 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.097+0000 7fd77fca5740 1 -- 172.21.15.103:0/2793287100 wait complete. 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.098+0000 7fd77fca5740 1 -- start start 2024-09-19T05:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.098+0000 7fd77fca5740 1 Processor -- start 2024-09-19T05:37:51.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.098+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fce1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.098+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8a750 0x55b25fccb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.098+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8ab30 0x55b25fcc9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77fca5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b25fbeb520 con 0x55b25fc8a750 2024-09-19T05:37:51.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b25fb74450 con 0x55b25fc8ab30 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55b25fcddeb0 con 0x55b25fc87f80 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77fca5740 10 client.0 _ll_register_callbacks cb 0x55b25f8fdac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8a750 0x55b25fccb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8a750 0x55b25fccb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60262/0 (socket says 172.21.15.103:60262) 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 -- 172.21.15.103:0/2078222913 learned_addr learned my addr 172.21.15.103:0/2078222913 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 -- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 msgr2=0x55b25fce1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8ab30 0x55b25fcc9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77659c640 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fce1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fce1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 -- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8ab30 msgr2=0x55b25fcc9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8ab30 0x55b25fcc9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 -- 172.21.15.103:0/2078222913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25f8fe2d0 con 0x55b25fc8a750 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8a750 0x55b25fccb0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd76c010240 tx=0x7fd76c010700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15256829411dafd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:51.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd7557fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd7557fa640 1 -- 172.21.15.103:0/2078222913 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0035f0 con 0x55b25fc8a750 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd7557fa640 1 -- 172.21.15.103:0/2078222913 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd76c003790 con 0x55b25fc8a750 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd77007e720 con 0x55b25fc8a750 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd7557fa640 1 -- 172.21.15.103:0/2078222913 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd76c021050 con 0x55b25fc8a750 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77fca5740 10 client.4428 fetch_fsmap learned FSMap version 6 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55b25f9c86b0 con 0x55b25fc8a750 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.099+0000 7fd7557fa640 1 -- 172.21.15.103:0/2078222913 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77007e720 con 0x55b25fc8a750 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd7557fa640 1 -- 172.21.15.103:0/2078222913 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7fd76c024020 con 0x55b25fc8a750 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77fca5740 10 client.4428 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77fca5740 10 client.4428 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77fca5740 20 client.4428 populate_metadata read hostname 'smithi103' 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0620 0x55b25fc87250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77fca5740 4 client.4428 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:51.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 --> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b25fbf8c50 con 0x55b25fcc0620 2024-09-19T05:37:51.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77659c640 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0620 0x55b25fc87250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:51.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd7557fa640 10 client.4428 ms_handle_connect on v2:172.21.15.103:6838/2567820767 2024-09-19T05:37:51.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:51.100+0000 7fd77659c640 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0620 0x55b25fc87250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d6a17550a9c4183 server_cookie=2f0fea9c3fa858aa in_seq=0 out_seq=0 2024-09-19T05:37:53.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.827+0000 7fd7557fa640 1 -- 172.21.15.103:0/2078222913 <== mds.0 v2:172.21.15.103:6838/2567820767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b25fbf8c50 con 0x55b25fcc0620 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.827+0000 7fd7557fa640 10 client.4428 handle_command_reply: tid=0 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.827+0000 7fd77fca5740 1 client.4428 shutdown 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8a750 msgr2=0x55b25fccb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8a750 0x55b25fccb0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd76c010240 tx=0x7fd76c010700 comp rx=0 tx=0).stop 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 shutdown_connections 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0620 0x55b25fc87250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8ab30 0x55b25fcc9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8a750 0x55b25fccb0b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2078222913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fce1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd7557fa640 0 client.4428 ms_handle_reset on v2:172.21.15.103:6838/2567820767 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 >> 172.21.15.103:0/2078222913 conn(0x55b25fc88e70 msgr2=0x55b25fc837c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:53.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 shutdown_connections 2024-09-19T05:37:53.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 1 -- 172.21.15.103:0/2078222913 wait complete. 2024-09-19T05:37:53.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.828+0000 7fd77fca5740 20 client.4428 trim_cache size 0 max 16384 2024-09-19T05:37:53.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.847+0000 7fd77fca5740 1 Processor -- start 2024-09-19T05:37:53.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.847+0000 7fd77fca5740 1 -- start start 2024-09-19T05:37:53.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fc88360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcbf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77fca5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd778157720 con 0x55b25fc8ab30 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b25fccbdb0 con 0x55b25fc87f80 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55b25fcc98d0 con 0x55b25fc8a750 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcbf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcbf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39886/0 (socket says 172.21.15.103:39886) 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 -- 172.21.15.103:0/2656079878 learned_addr learned my addr 172.21.15.103:0/2656079878 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77659c640 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fc88360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 -- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 msgr2=0x55b25fc888a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc888a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 -- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 msgr2=0x55b25fc88360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fc88360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd776d9d640 1 -- 172.21.15.103:0/2656079878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25fc85780 con 0x55b25fc8ab30 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd77659c640 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fc88360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.848+0000 7fd775d9b640 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc888a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.849+0000 7fd776d9d640 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcbf790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd77007a070 tx=0x7fd770048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77191334c2156ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.849+0000 7fd7577fe640 1 -- 172.21.15.103:0/2656079878 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770097070 con 0x55b25fc8ab30 2024-09-19T05:37:53.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.849+0000 7fd7577fe640 1 -- 172.21.15.103:0/2656079878 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77007e720 con 0x55b25fc8ab30 2024-09-19T05:37:53.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.849+0000 7fd7577fe640 1 -- 172.21.15.103:0/2656079878 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770082f50 con 0x55b25fc8ab30 2024-09-19T05:37:53.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 -- 172.21.15.103:0/2656079878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 msgr2=0x55b25fcbf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcbf790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd77007a070 tx=0x7fd770048000 comp rx=0 tx=0).stop 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 -- 172.21.15.103:0/2656079878 shutdown_connections 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fcbf790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc8a750 0x55b25fc888a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 --2- 172.21.15.103:0/2656079878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc87f80 0x55b25fc88360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 -- 172.21.15.103:0/2656079878 >> 172.21.15.103:0/2656079878 conn(0x55b25fc88e70 msgr2=0x55b25fcc27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 -- 172.21.15.103:0/2656079878 shutdown_connections 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 -- 172.21.15.103:0/2656079878 wait complete. 2024-09-19T05:37:53.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 -- start start 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.850+0000 7fd77fca5740 1 Processor -- start 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.851+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fcbfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8a750 0x55b25fcbe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77fca5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fd45f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77fca5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b25fc870d0 con 0x55b25fc8ab30 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b25fc86a20 con 0x55b25fc8a750 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77fca5740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55b25fc877a0 con 0x55b25fc87f80 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77fca5740 10 client.0 _ll_register_callbacks cb 0x7fd76c001250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fd45f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fd45f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39900/0 (socket says 172.21.15.103:39900) 2024-09-19T05:37:53.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 -- 172.21.15.103:0/3704663946 learned_addr learned my addr 172.21.15.103:0/3704663946 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77659c640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fcbfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd775d9b640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8a750 0x55b25fcbe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 -- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 msgr2=0x55b25fcbfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fcbfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 -- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8a750 msgr2=0x55b25fcbe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8a750 0x55b25fcbe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 -- 172.21.15.103:0/3704663946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25fce7410 con 0x55b25fc8ab30 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd776d9d640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fd45f40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd7700aa830 tx=0x7fd770009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4555234b9bad240a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd7557fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd7557fa640 1 -- 172.21.15.103:0/3704663946 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770097030 con 0x55b25fc8ab30 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd7557fa640 1 -- 172.21.15.103:0/3704663946 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd77004dd90 con 0x55b25fc8ab30 2024-09-19T05:37:53.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.852+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd77007e720 con 0x55b25fc8ab30 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd7557fa640 1 -- 172.21.15.103:0/3704663946 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd770031600 con 0x55b25fc8ab30 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 10 client.4434 fetch_fsmap learned FSMap version 6 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55b25fce7410 con 0x55b25fc8ab30 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd7557fa640 1 -- 172.21.15.103:0/3704663946 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77007e720 con 0x55b25fc8ab30 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd7557fa640 1 -- 172.21.15.103:0/3704663946 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7fd770092180 con 0x55b25fc8ab30 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 10 client.4434 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 20 client.4434 populate_metadata read hostname 'smithi103' 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 0x55b25fcc0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 4 client.4434 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 --> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] -- command(tid 0: {"prefix": "status"}) -- 0x55b25fbf2fa0 con 0x55b25fcc0b20 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77659c640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 0x55b25fcc0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:53.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77659c640 1 -- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 msgr2=0x55b25fcc0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 17 2024-09-19T05:37:53.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77659c640 1 -- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 msgr2=0x55b25fcc0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:37:53.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77659c640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 0x55b25fcc0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:37:53.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:53.853+0000 7fd77659c640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 0x55b25fcc0f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:37:54.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd77659c640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 0x55b25fcc0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd77659c640 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 0x55b25fcc0f00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23d9186e74424383 server_cookie=8fe9d354c0bdf4bc in_seq=0 out_seq=0 2024-09-19T05:37:54.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd7557fa640 10 client.4434 ms_handle_connect on v2:172.21.15.103:6838/2567820767 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd7557fa640 1 -- 172.21.15.103:0/3704663946 <== mds.0 v2:172.21.15.103:6838/2567820767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x55b25fbf2fa0 con 0x55b25fcc0b20 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd7557fa640 10 client.4434 handle_command_reply: tid=0 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd77fca5740 1 client.4434 shutdown 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 msgr2=0x55b25fd45f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.054+0000 7fd77fca5740 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fd45f40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd7700aa830 tx=0x7fd770009810 comp rx=0 tx=0).stop 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 shutdown_connections 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55b25fcc0b20 0x55b25fcc0f00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b25fc8ab30 0x55b25fd45f40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b25fc8a750 0x55b25fcbe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 --2- 172.21.15.103:0/3704663946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55b25fc87f80 0x55b25fcbfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd7557fa640 0 client.4434 ms_handle_reset on v2:172.21.15.103:6838/2567820767 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 >> 172.21.15.103:0/3704663946 conn(0x55b25fc88e70 msgr2=0x55b25fc88360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 shutdown_connections 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 1 -- 172.21.15.103:0/3704663946 wait complete. 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.055+0000 7fd77fca5740 20 client.4434 trim_cache size 0 max 16384 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4302, 2024-09-19T05:37:54.059 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 10.28377908, 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 5, 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 26, 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 25, 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 16.307007959 2024-09-19T05:37:54.060 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd75806c2b0 msgr2=0x7fd75806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd75806c2b0 0x7fd75806e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd76800b810 tx=0x7fd768008040 comp rx=0 tx=0).stop 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd778151ea0 msgr2=0x7fd77806be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd778151ea0 0x7fd77806be80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd770034040 tx=0x7fd770004a40 comp rx=0 tx=0).stop 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 shutdown_connections 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd75806c2b0 0x7fd75806e770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd778151ea0 0x7fd77806be80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7780c46c0 0x7fd77814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 --2- 172.21.15.103:0/2149502970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7780c3a50 0x7fd77814d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 >> 172.21.15.103:0/2149502970 conn(0x7fd7780c9230 msgr2=0x7fd7780c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 shutdown_connections 2024-09-19T05:37:54.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.056+0000 7fd77cf11640 1 -- 172.21.15.103:0/2149502970 wait complete. 2024-09-19T05:37:54.073 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:37:54.073 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:54.073 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:37:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.181+0000 7fca3fcc9640 1 Processor -- start 2024-09-19T05:37:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.181+0000 7fca3fcc9640 1 -- start start 2024-09-19T05:37:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3fcc9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 0x7fca380c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3fcc9640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca380cb060 con 0x7fca38155040 2024-09-19T05:37:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3fcc9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca380742d0 con 0x7fca3815eae0 2024-09-19T05:37:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3fcc9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fca3806cc80 con 0x7fca38073960 2024-09-19T05:37:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3da65640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fca38155040 0x7fca3815e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54608/0 (socket says 172.21.15.103:54608) 2024-09-19T05:37:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3da65640 1 -- 172.21.15.103:0/415757605 learned_addr learned my addr 172.21.15.103:0/415757605 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589017452 0 0) 0x7fca380cb060 con 0x7fca38155040 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca24003520 con 0x7fca38155040 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3e266640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 0x7fca380c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2743723931 0 0) 0x7fca24003520 con 0x7fca38155040 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 msgr2=0x7fca380c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 0x7fca380c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 >> v1:172.21.15.174:6789/0 conn(0x7fca3815eae0 legacy=0x7fca38163750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3815ef70 con 0x7fca38155040 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fca34001670 con 0x7fca38155040 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 >> v1:172.21.15.103:6789/0 conn(0x7fca38155040 legacy=0x7fca3815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca240039e0 0x7fca24003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 0x7fca24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca24004d40 0x7fca240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca3806cc80 con 0x7fca240039e0 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca2400bb00 con 0x7fca24004d40 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fca2400bd00 con 0x7fca38073960 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.182+0000 7fca3da65640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca240039e0 0x7fca24003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3e266640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca24004d40 0x7fca240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3d264640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 0x7fca24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3da65640 1 -- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 msgr2=0x7fca24004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3da65640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 0x7fca24004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3da65640 1 -- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca24004d40 msgr2=0x7fca240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3da65640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca24004d40 0x7fca240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3da65640 1 -- 172.21.15.103:0/415757605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24003520 con 0x7fca240039e0 2024-09-19T05:37:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3d264640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca38073960 0x7fca24004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.183+0000 7fca3da65640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca240039e0 0x7fca24003e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c210 tx=0x7fca24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf269b0e028e0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34007cf0 con 0x7fca240039e0 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca34005af0 con 0x7fca240039e0 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3ca63640 1 -- 172.21.15.103:0/415757605 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34007070 con 0x7fca240039e0 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3fcc9640 1 -- 172.21.15.103:0/415757605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca240039e0 msgr2=0x7fca24003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3fcc9640 1 --2- 172.21.15.103:0/415757605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca240039e0 0x7fca24003e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c210 tx=0x7fca24005830 comp rx=0 tx=0).stop 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3e266640 1 -- 172.21.15.103:0/415757605 reap_dead start 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3fcc9640 1 -- 172.21.15.103:0/415757605 shutdown_connections 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3fcc9640 1 -- 172.21.15.103:0/415757605 >> 172.21.15.103:0/415757605 conn(0x7fca380ca140 msgr2=0x7fca380ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3fcc9640 1 -- 172.21.15.103:0/415757605 shutdown_connections 2024-09-19T05:37:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.184+0000 7fca3fcc9640 1 -- 172.21.15.103:0/415757605 wait complete. 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.185+0000 7fca3fcc9640 1 Processor -- start 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3fcc9640 1 -- start start 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3fcc9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca240039e0 0x7fca380cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3fcc9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca38157bf0 0x7fca3815d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3fcc9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca381582f0 0x7fca3815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3fcc9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca38073f90 con 0x7fca38157bf0 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3fcc9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca3806c9a0 con 0x7fca381582f0 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3fcc9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fca3815f250 con 0x7fca240039e0 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3d264640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca38157bf0 0x7fca3815d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3d264640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca38157bf0 0x7fca3815d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39920/0 (socket says 172.21.15.103:39920) 2024-09-19T05:37:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.186+0000 7fca3d264640 1 -- 172.21.15.103:0/554461326 learned_addr learned my addr 172.21.15.103:0/554461326 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3da65640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca240039e0 0x7fca380cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3e266640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca381582f0 0x7fca3815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3d264640 1 -- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca240039e0 msgr2=0x7fca380cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3d264640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca240039e0 0x7fca380cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3d264640 1 -- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca381582f0 msgr2=0x7fca3815d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3d264640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca381582f0 0x7fca3815d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3d264640 1 -- 172.21.15.103:0/554461326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca381f0c00 con 0x7fca38157bf0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3d264640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca38157bf0 0x7fca3815d450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca2800e580 tx=0x7fca2800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca2e7fc640 1 -- 172.21.15.103:0/554461326 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca280052e0 con 0x7fca38157bf0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca2e7fc640 1 -- 172.21.15.103:0/554461326 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28018070 con 0x7fca38157bf0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca381f0ee0 con 0x7fca38157bf0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca2e7fc640 1 -- 172.21.15.103:0/554461326 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28003830 con 0x7fca38157bf0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.187+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca381f14a0 con 0x7fca38157bf0 2024-09-19T05:37:54.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.188+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca38155420 con 0x7fca38157bf0 2024-09-19T05:37:54.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.188+0000 7fca2e7fc640 1 -- 172.21.15.103:0/554461326 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca280039d0 con 0x7fca38157bf0 2024-09-19T05:37:54.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.189+0000 7fca2e7fc640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fca1c06c2e0 0x7fca1c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:54.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.189+0000 7fca2e7fc640 1 -- 172.21.15.103:0/554461326 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fca2808b3d0 con 0x7fca38157bf0 2024-09-19T05:37:54.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.189+0000 7fca3da65640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fca1c06c2e0 0x7fca1c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:54.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.189+0000 7fca3da65640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fca1c06c2e0 0x7fca1c06e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca34032000 tx=0x7fca34009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:54.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.193+0000 7fca2e7fc640 1 -- 172.21.15.103:0/554461326 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fca28059810 con 0x7fca38157bf0 2024-09-19T05:37:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.393+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fca38155bb0 con 0x7fca38157bf0 2024-09-19T05:37:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.393+0000 7fca2e7fc640 1 -- 172.21.15.103:0/554461326 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fca28059110 con 0x7fca38157bf0 2024-09-19T05:37:54.396 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:37:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fca1c06c2e0 msgr2=0x7fca1c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fca1c06c2e0 0x7fca1c06e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca34032000 tx=0x7fca34009030 comp rx=0 tx=0).stop 2024-09-19T05:37:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca38157bf0 msgr2=0x7fca3815d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca38157bf0 0x7fca3815d450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca2800e580 tx=0x7fca2800ea40 comp rx=0 tx=0).stop 2024-09-19T05:37:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 shutdown_connections 2024-09-19T05:37:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fca1c06c2e0 0x7fca1c06e7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca381582f0 0x7fca3815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca38157bf0 0x7fca3815d450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 --2- 172.21.15.103:0/554461326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca240039e0 0x7fca380cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 >> 172.21.15.103:0/554461326 conn(0x7fca380ca140 msgr2=0x7fca38151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 shutdown_connections 2024-09-19T05:37:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54.395+0000 7fca3fcc9640 1 -- 172.21.15.103:0/554461326 wait complete. 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:37:54.409 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:37:54.410 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T05:37:54.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:54.410 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-19T05:37:54.425 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:37:54.426 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:37:54.426 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:37:54.426 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:54.426 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-19T05:37:54.426 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:54.426 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:37:54.426 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42791sec preferred_lft 42791sec 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-19T05:37:54.427 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:37:54.428 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:37:54.428 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:37:54.428 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:37:54.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:37:54.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-19T05:37:54.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-19T05:37:54.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:37:54.429 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:37:54.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:37:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:54.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:54.625 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:37:54.650 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-19T05:37:54.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:54.652 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-19T05:37:54.727 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-19T05:37:54.728 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:37:54.728 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:37:54.729 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:37:54.729 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:37:54.729 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:37:54.730 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:37:54.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:37:54.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:37:54.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:37:54.730 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:37:54.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:37:55.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:55.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:55.047 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-19T05:37:55.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:55.062 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-19T05:37:55.118 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:37:55.118 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:37:55.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:37:55.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T05:37:55.119 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:37:55.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:37:55.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:55.237 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T05:37:55.238 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:37:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:37:55.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:55.365 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:37:55.366 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:37:55.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-19T05:37:55.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:37:55.366 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:37:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:37:55.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:55.443 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T05:37:55.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:37:55.443 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:55.460 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T05:37:55.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:37:55.460 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:55.515 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-19T05:37:55.581 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:37:55.637 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-19T05:37:55.637 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-19T05:37:55.637 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-19T05:37:55.637 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-19T05:37:55.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-19T05:37:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:37:55.640 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:37:55.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:55.640 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-19T05:37:55.692 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:37:55.692 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T05:37:55.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-19T05:37:55.758 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:37:55.815 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-19T05:37:55.815 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-19T05:37:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:37:55.817 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-19T05:37:55.818 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:37:55.818 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:37:55.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:55.818 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-19T05:37:55.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:2024-09-19T05:37:55.821+0000 7f6e98215480 -1 init, newargv = 0x55eab176a740 newargc=15 2024-09-19T05:37:55.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[41785]: starting ceph client 2024-09-19T05:37:55.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[41785]: starting fuse 2024-09-19T05:37:55.839 INFO:teuthology.orchestra.run.smithi103.stdout:41 2024-09-19T05:37:55.839 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T05:37:55.840 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-19T05:37:55.841 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:37:55.842 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:37:55.842 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.admin")) 2024-09-19T05:37:55.842 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-19T05:37:55.957 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.admin.41785.asok 2024-09-19T05:37:55.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:55.967 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41785.asok 2024-09-19T05:37:55.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:55.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41785.asok status 2024-09-19T05:37:56.102 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:37:56.102 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-19T05:37:56.102 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "admin", 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "41785", 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4446, 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-19T05:37:56.103 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4446 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1152199017 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1152199017 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:37:56.104 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4446 192.168.0.1:0/1152199017", 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1152199017", 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 5, 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 26, 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-19T05:37:56.105 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:37:56.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:56.111 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-19T05:37:56.111 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:56.127 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-19T05:37:56.127 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:56.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:56.127 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:56.193 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T05:37:56.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:37:56.307 INFO:teuthology.orchestra.run.smithi103.stdout:# file: . 2024-09-19T05:37:56.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T05:37:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:37:56.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:37:56.313 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:56.313 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:56.330 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:37:56.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.467+0000 7f1b82a77640 1 Processor -- start 2024-09-19T05:37:56.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.467+0000 7f1b82a77640 1 -- start start 2024-09-19T05:37:56.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b82a77640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b7c152cc0 0x7f1b7c071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b82a77640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1b7c1530a0 0x7f1b7c071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b82a77640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c15c670 0x7f1b7c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b82a77640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c0cf570 con 0x7f1b7c152cc0 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b82a77640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c15d000 con 0x7f1b7c1530a0 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b82a77640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c0c8a90 con 0x7f1b7c15c670 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b7c152cc0 0x7f1b7c071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b7c152cc0 0x7f1b7c071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39936/0 (socket says 172.21.15.103:39936) 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 -- 172.21.15.103:0/3131592535 learned_addr learned my addr 172.21.15.103:0/3131592535 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b73fff640 1 --2- 172.21.15.103:0/3131592535 >> v2:172.21.15.174:3300/0 conn(0x7f1b7c1530a0 0x7f1b7c071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b81014640 1 --2- 172.21.15.103:0/3131592535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c15c670 0x7f1b7c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 -- 172.21.15.103:0/3131592535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c15c670 msgr2=0x7f1b7c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 --2- 172.21.15.103:0/3131592535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c15c670 0x7f1b7c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 -- 172.21.15.103:0/3131592535 >> v2:172.21.15.174:3300/0 conn(0x7f1b7c1530a0 msgr2=0x7f1b7c071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 --2- 172.21.15.103:0/3131592535 >> v2:172.21.15.174:3300/0 conn(0x7f1b7c1530a0 0x7f1b7c071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.468+0000 7f1b80813640 1 -- 172.21.15.103:0/3131592535 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c0c7f10 con 0x7f1b7c152cc0 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.469+0000 7f1b80813640 1 --2- 172.21.15.103:0/3131592535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c152cc0 0x7f1b7c071120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0c5580 tx=0x7f1b7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bd2aa70d826f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.469+0000 7f1b737fe640 1 -- 172.21.15.103:0/3131592535 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78037070 con 0x7f1b7c152cc0 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.469+0000 7f1b737fe640 1 -- 172.21.15.103:0/3131592535 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b78032440 con 0x7f1b7c152cc0 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.469+0000 7f1b737fe640 1 -- 172.21.15.103:0/3131592535 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78032810 con 0x7f1b7c152cc0 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 -- 172.21.15.103:0/3131592535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c152cc0 msgr2=0x7f1b7c071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 --2- 172.21.15.103:0/3131592535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c152cc0 0x7f1b7c071120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0c5580 tx=0x7f1b7802a270 comp rx=0 tx=0).stop 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 -- 172.21.15.103:0/3131592535 shutdown_connections 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 --2- 172.21.15.103:0/3131592535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c15c670 0x7f1b7c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 --2- 172.21.15.103:0/3131592535 >> v2:172.21.15.174:3300/0 conn(0x7f1b7c1530a0 0x7f1b7c071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 --2- 172.21.15.103:0/3131592535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c152cc0 0x7f1b7c071120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 -- 172.21.15.103:0/3131592535 >> 172.21.15.103:0/3131592535 conn(0x7f1b7c06f910 msgr2=0x7f1b7c0735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:56.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 -- 172.21.15.103:0/3131592535 shutdown_connections 2024-09-19T05:37:56.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.470+0000 7f1b82a77640 1 -- 172.21.15.103:0/3131592535 wait complete. 2024-09-19T05:37:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.471+0000 7f1b82a77640 1 Processor -- start 2024-09-19T05:37:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.471+0000 7f1b82a77640 1 -- start start 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c152cc0 0x7f1b7c1e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c1530a0 0x7f1b7c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c15c670 0x7f1b7c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0c87b0 con 0x7f1b7c15c670 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0c84d0 con 0x7f1b7c152cc0 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c15c150 con 0x7f1b7c1530a0 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c15c670 0x7f1b7c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c15c670 0x7f1b7c155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39942/0 (socket says 172.21.15.103:39942) 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 -- 172.21.15.103:0/794170768 learned_addr learned my addr 172.21.15.103:0/794170768 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b73fff640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c1530a0 0x7f1b7c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b80813640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c152cc0 0x7f1b7c1e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 -- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c1530a0 msgr2=0x7f1b7c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c1530a0 0x7f1b7c155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 -- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c152cc0 msgr2=0x7f1b7c1e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c152cc0 0x7f1b7c1e3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 -- 172.21.15.103:0/794170768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c1e24f0 con 0x7f1b7c15c670 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b73fff640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c1530a0 0x7f1b7c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b81014640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c15c670 0x7f1b7c155fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b74007d20 tx=0x7f1b7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b717fa640 1 -- 172.21.15.103:0/794170768 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74014420 con 0x7f1b7c15c670 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b717fa640 1 -- 172.21.15.103:0/794170768 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b74019070 con 0x7f1b7c15c670 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c1e27d0 con 0x7f1b7c15c670 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b717fa640 1 -- 172.21.15.103:0/794170768 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74014820 con 0x7f1b7c15c670 2024-09-19T05:37:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.472+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c154f80 con 0x7f1b7c15c670 2024-09-19T05:37:56.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.473+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7c0500a0 con 0x7f1b7c15c670 2024-09-19T05:37:56.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.474+0000 7f1b717fa640 1 -- 172.21.15.103:0/794170768 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b740149c0 con 0x7f1b7c15c670 2024-09-19T05:37:56.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.474+0000 7f1b717fa640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1b6806c2b0 0x7f1b6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.474+0000 7f1b717fa640 1 -- 172.21.15.103:0/794170768 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1b7408bff0 con 0x7f1b7c15c670 2024-09-19T05:37:56.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.474+0000 7f1b80813640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1b6806c2b0 0x7f1b6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.475+0000 7f1b80813640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1b6806c2b0 0x7f1b6806e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b78034000 tx=0x7f1b7802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.479+0000 7f1b717fa640 1 -- 172.21.15.103:0/794170768 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1b7c0500a0 con 0x7f1b7c15c670 2024-09-19T05:37:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.654+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b7c0c7b90 con 0x7f1b7c15c670 2024-09-19T05:37:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.654+0000 7f1b717fa640 1 -- 172.21.15.103:0/794170768 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f1b7405a390 con 0x7f1b7c15c670 2024-09-19T05:37:56.657 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-19T05:37:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1b6806c2b0 msgr2=0x7f1b6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1b6806c2b0 0x7f1b6806e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b78034000 tx=0x7f1b7802e000 comp rx=0 tx=0).stop 2024-09-19T05:37:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c15c670 msgr2=0x7f1b7c155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c15c670 0x7f1b7c155fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b74007d20 tx=0x7f1b7400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 shutdown_connections 2024-09-19T05:37:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1b6806c2b0 0x7f1b6806e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7c15c670 0x7f1b7c155fa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b7c1530a0 0x7f1b7c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 --2- 172.21.15.103:0/794170768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b7c152cc0 0x7f1b7c1e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 >> 172.21.15.103:0/794170768 conn(0x7f1b7c06f910 msgr2=0x7f1b7c0cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 shutdown_connections 2024-09-19T05:37:56.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.656+0000 7f1b82a77640 1 -- 172.21.15.103:0/794170768 wait complete. 2024-09-19T05:37:56.669 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:37:56.669 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:37:56.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:37:56.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.821+0000 7f36039af640 1 Processor -- start 2024-09-19T05:37:56.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.822+0000 7f36039af640 1 -- start start 2024-09-19T05:37:56.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.822+0000 7f36039af640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35fc0c3a50 0x7f35fc0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.822+0000 7f36039af640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc15bc80 con 0x7f35fc151ea0 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.822+0000 7f36039af640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc157c70 con 0x7f35fc0c46c0 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.822+0000 7f36039af640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f35fc1585a0 con 0x7f35fc0c3a50 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f360174b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f35fc151ea0 0x7f35fc158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54620/0 (socket says 172.21.15.103:54620) 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f360174b640 1 -- 172.21.15.103:0/1009684203 learned_addr learned my addr 172.21.15.103:0/1009684203 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f3601f4c640 1 --2- 172.21.15.103:0/1009684203 >> v2:172.21.15.174:3300/0 conn(0x7f35fc0c3a50 0x7f35fc0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371329322 0 0) 0x7f35fc15bc80 con 0x7f35fc151ea0 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e8003520 con 0x7f35fc151ea0 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2032883649 0 0) 0x7f35e8003520 con 0x7f35fc151ea0 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 >> v2:172.21.15.174:3300/0 conn(0x7f35fc0c3a50 msgr2=0x7f35fc0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 --2- 172.21.15.103:0/1009684203 >> v2:172.21.15.174:3300/0 conn(0x7f35fc0c3a50 0x7f35fc0c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 >> v1:172.21.15.174:6789/0 conn(0x7f35fc0c46c0 legacy=0x7f35fc06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc157f50 con 0x7f35fc151ea0 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f35f8001670 con 0x7f35fc151ea0 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 >> v1:172.21.15.103:6789/0 conn(0x7f35fc151ea0 legacy=0x7f35fc158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e8004800 0x7f35e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e80051c0 0x7f35e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc1585a0 con 0x7f35e80039b0 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f35e800c070 con 0x7f35e80051c0 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f35e800c270 con 0x7f35e8004800 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f360174b640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.823+0000 7f3600f4a640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e8004800 0x7f35e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f3601f4c640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e80051c0 0x7f35e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f360174b640 1 -- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e8004800 msgr2=0x7f35e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f360174b640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e8004800 0x7f35e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f360174b640 1 -- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e80051c0 msgr2=0x7f35e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f360174b640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e80051c0 0x7f35e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f360174b640 1 -- 172.21.15.103:0/1009684203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8003520 con 0x7f35e80039b0 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f3601f4c640 1 -- 172.21.15.103:0/1009684203 reap_dead start 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.824+0000 7f360174b640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35e8003dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c210 tx=0x7f35e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20b1eb927f356e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8007d30 con 0x7f35e80039b0 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f8005ad0 con 0x7f35e80039b0 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f35effff640 1 -- 172.21.15.103:0/1009684203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8007070 con 0x7f35e80039b0 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f36039af640 1 -- 172.21.15.103:0/1009684203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 msgr2=0x7f35e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f36039af640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35e8003dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c210 tx=0x7f35e8005830 comp rx=0 tx=0).stop 2024-09-19T05:37:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f36039af640 1 -- 172.21.15.103:0/1009684203 shutdown_connections 2024-09-19T05:37:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f36039af640 1 --2- 172.21.15.103:0/1009684203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35e8003dd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f36039af640 1 -- 172.21.15.103:0/1009684203 >> 172.21.15.103:0/1009684203 conn(0x7f35fc0c9230 msgr2=0x7f35fc0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f36039af640 1 -- 172.21.15.103:0/1009684203 shutdown_connections 2024-09-19T05:37:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.825+0000 7f36039af640 1 -- 172.21.15.103:0/1009684203 wait complete. 2024-09-19T05:37:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.826+0000 7f36039af640 1 Processor -- start 2024-09-19T05:37:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.826+0000 7f36039af640 1 -- start start 2024-09-19T05:37:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f36039af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35fc0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f36039af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35fc0c4e50 0x7f35fc1478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f36039af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35fc1e4db0 0x7f35fc150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f36039af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc158a30 con 0x7f35e80039b0 2024-09-19T05:37:56.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f36039af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc152280 con 0x7f35fc0c4e50 2024-09-19T05:37:56.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f36039af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc15bf20 con 0x7f35fc1e4db0 2024-09-19T05:37:56.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f360174b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35fc0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f360174b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35fc0ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39974/0 (socket says 172.21.15.103:39974) 2024-09-19T05:37:56.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f360174b640 1 -- 172.21.15.103:0/632250196 learned_addr learned my addr 172.21.15.103:0/632250196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:37:56.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f3601f4c640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35fc1e4db0 0x7f35fc150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f3600f4a640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35fc0c4e50 0x7f35fc1478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f360174b640 1 -- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35fc1e4db0 msgr2=0x7f35fc150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f360174b640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35fc1e4db0 0x7f35fc150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f360174b640 1 -- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35fc0c4e50 msgr2=0x7f35fc1478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:56.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.827+0000 7f360174b640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35fc0c4e50 0x7f35fc1478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:56.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.828+0000 7f360174b640 1 -- 172.21.15.103:0/632250196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc1f2850 con 0x7f35e80039b0 2024-09-19T05:37:56.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.828+0000 7f360174b640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35fc0ca350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c210 tx=0x7f35f8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.828+0000 7f35edffb640 1 -- 172.21.15.103:0/632250196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8037040 con 0x7f35e80039b0 2024-09-19T05:37:56.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.828+0000 7f35edffb640 1 -- 172.21.15.103:0/632250196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f80047e0 con 0x7f35e80039b0 2024-09-19T05:37:56.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.828+0000 7f35edffb640 1 -- 172.21.15.103:0/632250196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8001670 con 0x7f35e80039b0 2024-09-19T05:37:56.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.828+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35fc1ee830 con 0x7f35e80039b0 2024-09-19T05:37:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.828+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35fc1eeaf0 con 0x7f35e80039b0 2024-09-19T05:37:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.829+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35fc0c89b0 con 0x7f35e80039b0 2024-09-19T05:37:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.829+0000 7f35edffb640 1 -- 172.21.15.103:0/632250196 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f35f8004bb0 con 0x7f35e80039b0 2024-09-19T05:37:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.830+0000 7f35edffb640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f35e006c2b0 0x7f35e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.830+0000 7f35edffb640 1 -- 172.21.15.103:0/632250196 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f35f80ab380 con 0x7f35e80039b0 2024-09-19T05:37:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.830+0000 7f3600f4a640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f35e006c2b0 0x7f35e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.830+0000 7f3600f4a640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f35e006c2b0 0x7f35e006e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0c3280 tx=0x7f35f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:56.834+0000 7f35edffb640 1 -- 172.21.15.103:0/632250196 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f35f8007dd0 con 0x7f35e80039b0 2024-09-19T05:37:57.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.010+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f35fc0c4c30 con 0x7f35e80039b0 2024-09-19T05:37:57.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.010+0000 7f35edffb640 1 -- 172.21.15.103:0/632250196 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f35f80792d0 con 0x7f35e80039b0 2024-09-19T05:37:57.013 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-19T05:37:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f35e006c2b0 msgr2=0x7f35e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f35e006c2b0 0x7f35e006e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0c3280 tx=0x7f35f0009040 comp rx=0 tx=0).stop 2024-09-19T05:37:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 msgr2=0x7f35fc0ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35fc0ca350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c210 tx=0x7f35f8001a40 comp rx=0 tx=0).stop 2024-09-19T05:37:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 shutdown_connections 2024-09-19T05:37:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f35e006c2b0 0x7f35e006e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35fc1e4db0 0x7f35fc150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35fc0c4e50 0x7f35fc1478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 --2- 172.21.15.103:0/632250196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35e80039b0 0x7f35fc0ca350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 >> 172.21.15.103:0/632250196 conn(0x7f35fc0c9230 msgr2=0x7f35fc14e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 shutdown_connections 2024-09-19T05:37:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:37:57.012+0000 7f36039af640 1 -- 172.21.15.103:0/632250196 wait complete. 2024-09-19T05:37:57.025 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-19T05:37:57.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:37:57.025 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:37:57.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[41785]: fuse finished with error 0 and tester_r 0 2024-09-19T05:37:57.050 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:37:58.761 INFO:tasks.ceph.mds.e.smithi103.stderr:2024-09-19T05:37:58.759+0000 7f69a286b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:38:03.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:38:03.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:03.152 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T05:38:03.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:03.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.340+0000 7f5fa8cb7640 1 Processor -- start 2024-09-19T05:38:03.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.340+0000 7f5fa8cb7640 1 -- start start 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.341+0000 7f5fa8cb7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5fa4151ea0 0x7f5fa40c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.341+0000 7f5fa8cb7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 0x7f5fa406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.341+0000 7f5fa8cb7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa415bc80 con 0x7f5fa40c46c0 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.341+0000 7f5fa8cb7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa41585a0 con 0x7f5fa4151ea0 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.341+0000 7f5fa8cb7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa4157c70 con 0x7f5fa40c3a50 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.341+0000 7f5fa1d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5fa40c46c0 0x7f5fa4158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53326/0 (socket says 172.21.15.103:53326) 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.341+0000 7f5fa1d9b640 1 -- 172.21.15.103:0/881581957 learned_addr learned my addr 172.21.15.103:0/881581957 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:03.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa259c640 1 --2- 172.21.15.103:0/881581957 >> v2:172.21.15.174:3300/0 conn(0x7f5fa4151ea0 0x7f5fa40c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 0x7f5fa406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534759072 0 0) 0x7f5fa415bc80 con 0x7f5fa40c46c0 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f90003520 con 0x7f5fa40c46c0 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 592544189 0 0) 0x7f5f90003520 con 0x7f5fa40c46c0 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 msgr2=0x7f5fa406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 0x7f5fa406eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 >> v2:172.21.15.174:3300/0 conn(0x7f5fa4151ea0 msgr2=0x7f5fa40c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 --2- 172.21.15.103:0/881581957 >> v2:172.21.15.174:3300/0 conn(0x7f5fa4151ea0 0x7f5fa40c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa4157f50 con 0x7f5fa40c46c0 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f5f8c001670 con 0x7f5fa40c46c0 2024-09-19T05:38:03.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 >> v1:172.21.15.103:6789/0 conn(0x7f5fa40c46c0 legacy=0x7f5fa4158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f900039b0 0x7f5f90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 0x7f5f90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f90004d40 0x7f5f900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa41585a0 con 0x7f5f90004d40 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4157c70 con 0x7f5f900039b0 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9000b9c0 con 0x7f5fa40c3a50 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f90004d40 0x7f5f900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa259c640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f900039b0 0x7f5f90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa1d9b640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 0x7f5f90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 msgr2=0x7f5f90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa40c3a50 0x7f5f90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f900039b0 msgr2=0x7f5f90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f900039b0 0x7f5f90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.342+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/881581957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f90003520 con 0x7f5f90004d40 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.343+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f90004d40 0x7f5f900051c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009ac0 tx=0x7f5f90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbdf26d0bf9f291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.343+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c036070 con 0x7f5f90004d40 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.343+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c031400 con 0x7f5f90004d40 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.343+0000 7f5fa159a640 1 -- 172.21.15.103:0/881581957 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c009690 con 0x7f5f90004d40 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.344+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/881581957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f90004d40 msgr2=0x7f5f900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.344+0000 7f5fa8cb7640 1 --2- 172.21.15.103:0/881581957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f90004d40 0x7f5f900051c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009ac0 tx=0x7f5f90005830 comp rx=0 tx=0).stop 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.344+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/881581957 reap_dead start 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.344+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/881581957 shutdown_connections 2024-09-19T05:38:03.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.344+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/881581957 >> 172.21.15.103:0/881581957 conn(0x7f5fa40c9230 msgr2=0x7f5fa40c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.344+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/881581957 shutdown_connections 2024-09-19T05:38:03.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.344+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/881581957 wait complete. 2024-09-19T05:38:03.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.345+0000 7f5fa8cb7640 1 Processor -- start 2024-09-19T05:38:03.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.345+0000 7f5fa8cb7640 1 -- start start 2024-09-19T05:38:03.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa8cb7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f90004d40 0x7f5fa4156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa8cb7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa41558e0 0x7f5fa414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa8cb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa41f1b20 0x7f5fa40c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa8cb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa41596e0 con 0x7f5fa41f1b20 2024-09-19T05:38:03.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa8cb7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4152280 con 0x7f5f90004d40 2024-09-19T05:38:03.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa8cb7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa4158a30 con 0x7f5fa41558e0 2024-09-19T05:38:03.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa41f1b20 0x7f5fa40c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa41f1b20 0x7f5fa40c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46010/0 (socket says 172.21.15.103:46010) 2024-09-19T05:38:03.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/2419529023 learned_addr learned my addr 172.21.15.103:0/2419529023 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:03.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa259c640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f90004d40 0x7f5fa4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa1d9b640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa41558e0 0x7f5fa414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa41558e0 msgr2=0x7f5fa414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa41558e0 0x7f5fa414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f90004d40 msgr2=0x7f5fa4156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f90004d40 0x7f5fa4156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.346+0000 7f5fa2d9d640 1 -- 172.21.15.103:0/2419529023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa4155de0 con 0x7f5fa41f1b20 2024-09-19T05:38:03.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.347+0000 7f5fa2d9d640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa41f1b20 0x7f5fa40c5af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009ac0 tx=0x7f5f9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.347+0000 7f5f9affd640 1 -- 172.21.15.103:0/2419529023 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c036040 con 0x7f5fa41f1b20 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.347+0000 7f5f9affd640 1 -- 172.21.15.103:0/2419529023 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c041070 con 0x7f5fa41f1b20 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.347+0000 7f5f9affd640 1 -- 172.21.15.103:0/2419529023 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c009690 con 0x7f5fa41f1b20 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.347+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa41573f0 con 0x7f5fa41f1b20 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.347+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa40c32e0 con 0x7f5fa41f1b20 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.348+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa415bf20 con 0x7f5fa41f1b20 2024-09-19T05:38:03.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.348+0000 7f5f9affd640 1 -- 172.21.15.103:0/2419529023 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5f9c039070 con 0x7f5fa41f1b20 2024-09-19T05:38:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.349+0000 7f5f9affd640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5f8406c2e0 0x7f5f8406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.349+0000 7f5f9affd640 1 -- 172.21.15.103:0/2419529023 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5f9c0ab2e0 con 0x7f5fa41f1b20 2024-09-19T05:38:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.349+0000 7f5fa259c640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5f8406c2e0 0x7f5f8406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.349+0000 7f5fa259c640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5f8406c2e0 0x7f5f8406e7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f94014450 tx=0x7f5f9400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.353+0000 7f5f9affd640 1 -- 172.21.15.103:0/2419529023 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5f9c04b020 con 0x7f5fa41f1b20 2024-09-19T05:38:03.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.520+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fa4150140 con 0x7f5fa41f1b20 2024-09-19T05:38:03.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.521+0000 7f5f9affd640 1 -- 172.21.15.103:0/2419529023 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18670 (secure 0 0 0) 0x7f5f9c079030 con 0x7f5fa41f1b20 2024-09-19T05:38:03.524 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:03.524 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:49.821955+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5f8406c2e0 msgr2=0x7f5f8406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5f8406c2e0 0x7f5f8406e7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f94014450 tx=0x7f5f9400b040 comp rx=0 tx=0).stop 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa41f1b20 msgr2=0x7f5fa40c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa41f1b20 0x7f5fa40c5af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009ac0 tx=0x7f5f9c004730 comp rx=0 tx=0).stop 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 shutdown_connections 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5f8406c2e0 0x7f5f8406e7a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa41f1b20 0x7f5fa40c5af0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa41558e0 0x7f5fa414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 --2- 172.21.15.103:0/2419529023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f90004d40 0x7f5fa4156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 >> 172.21.15.103:0/2419529023 conn(0x7f5fa40c9230 msgr2=0x7f5fa406ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 shutdown_connections 2024-09-19T05:38:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.523+0000 7f5fa8cb7640 1 -- 172.21.15.103:0/2419529023 wait complete. 2024-09-19T05:38:03.536 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.634+0000 7fa35847b640 1 Processor -- start 2024-09-19T05:38:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.634+0000 7fa35847b640 1 -- start start 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa35847b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3501550b0 0x7fa350073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa35847b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa35006d730 0x7fa3500ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa35847b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3500c9d00 con 0x7fa350155490 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa35847b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa35015edb0 con 0x7fa35006d730 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa35847b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa35015e4a0 con 0x7fa3501550b0 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa355a16640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa35006d730 0x7fa3500ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa355a16640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa35006d730 0x7fa3500ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46020/0 (socket says 172.21.15.103:46020) 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa355a16640 1 -- 172.21.15.103:0/582870699 learned_addr learned my addr 172.21.15.103:0/582870699 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa356217640 1 --2- 172.21.15.103:0/582870699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3501550b0 0x7fa350073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa355a16640 1 -- 172.21.15.103:0/582870699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3501550b0 msgr2=0x7fa350073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa355a16640 1 --2- 172.21.15.103:0/582870699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3501550b0 0x7fa350073f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa355a16640 1 -- 172.21.15.103:0/582870699 >> v1:172.21.15.174:6789/0 conn(0x7fa350155490 legacy=0x7fa3500ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.635+0000 7fa355a16640 1 -- 172.21.15.103:0/582870699 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3500c9fc0 con 0x7fa35006d730 2024-09-19T05:38:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.636+0000 7fa355a16640 1 --2- 172.21.15.103:0/582870699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa35006d730 0x7fa3500ca2a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa340009870 tx=0x7fa34002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65502dc550cc385 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.636+0000 7fa355215640 1 -- 172.21.15.103:0/582870699 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340037070 con 0x7fa35006d730 2024-09-19T05:38:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.636+0000 7fa355215640 1 -- 172.21.15.103:0/582870699 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34002ae50 con 0x7fa35006d730 2024-09-19T05:38:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.636+0000 7fa355215640 1 -- 172.21.15.103:0/582870699 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340032860 con 0x7fa35006d730 2024-09-19T05:38:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 -- 172.21.15.103:0/582870699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa35006d730 msgr2=0x7fa3500ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 --2- 172.21.15.103:0/582870699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa35006d730 0x7fa3500ca2a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa340009870 tx=0x7fa34002a300 comp rx=0 tx=0).stop 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 -- 172.21.15.103:0/582870699 shutdown_connections 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 --2- 172.21.15.103:0/582870699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa35006d730 0x7fa3500ca2a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 --2- 172.21.15.103:0/582870699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3501550b0 0x7fa350073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 -- 172.21.15.103:0/582870699 >> 172.21.15.103:0/582870699 conn(0x7fa35006c240 msgr2=0x7fa350067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 -- 172.21.15.103:0/582870699 shutdown_connections 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.637+0000 7fa35847b640 1 -- 172.21.15.103:0/582870699 wait complete. 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.638+0000 7fa35847b640 1 Processor -- start 2024-09-19T05:38:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.638+0000 7fa35847b640 1 -- start start 2024-09-19T05:38:03.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3501550b0 0x7fa3501f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa350155490 0x7fa3501e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa35015d030 0x7fa350148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa35015f240 con 0x7fa3501550b0 2024-09-19T05:38:03.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa35015ea40 con 0x7fa35015d030 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa3500c2750 con 0x7fa350155490 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3501550b0 0x7fa3501f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3501550b0 0x7fa3501f4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46026/0 (socket says 172.21.15.103:46026) 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 -- 172.21.15.103:0/3302642215 learned_addr learned my addr 172.21.15.103:0/3302642215 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa355a16640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa350155490 0x7fa3501e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356a18640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa35015d030 0x7fa350148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 -- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa350155490 msgr2=0x7fa3501e62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa350155490 0x7fa3501e62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 -- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa35015d030 msgr2=0x7fa350148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa35015d030 0x7fa350148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 -- 172.21.15.103:0/3302642215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3500ce320 con 0x7fa3501550b0 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa356217640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3501550b0 0x7fa3501f4bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00d860 tx=0x7fa34c00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa346ffd640 1 -- 172.21.15.103:0/3302642215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00de50 con 0x7fa3501550b0 2024-09-19T05:38:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa346ffd640 1 -- 172.21.15.103:0/3302642215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34c019070 con 0x7fa3501550b0 2024-09-19T05:38:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35015c270 con 0x7fa3501550b0 2024-09-19T05:38:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa346ffd640 1 -- 172.21.15.103:0/3302642215 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00baf0 con 0x7fa3501550b0 2024-09-19T05:38:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.639+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35015c830 con 0x7fa3501550b0 2024-09-19T05:38:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.640+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa350074520 con 0x7fa3501550b0 2024-09-19T05:38:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.641+0000 7fa346ffd640 1 -- 172.21.15.103:0/3302642215 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa34c00bc90 con 0x7fa3501550b0 2024-09-19T05:38:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.641+0000 7fa346ffd640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33406c2e0 0x7fa33406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.641+0000 7fa346ffd640 1 -- 172.21.15.103:0/3302642215 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa34c08bbc0 con 0x7fa3501550b0 2024-09-19T05:38:03.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.641+0000 7fa355a16640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33406c2e0 0x7fa33406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.642+0000 7fa355a16640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33406c2e0 0x7fa33406e7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa340034000 tx=0x7fa34002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.645+0000 7fa346ffd640 1 -- 172.21.15.103:0/3302642215 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa34c059ff0 con 0x7fa3501550b0 2024-09-19T05:38:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.813+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3500c9710 con 0x7fa3501550b0 2024-09-19T05:38:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.815+0000 7fa346ffd640 1 -- 172.21.15.103:0/3302642215 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18670 (secure 0 0 0) 0x7fa34c0598f0 con 0x7fa3501550b0 2024-09-19T05:38:03.816 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:03.816 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:49.821955+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:03.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33406c2e0 msgr2=0x7fa33406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33406c2e0 0x7fa33406e7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa340034000 tx=0x7fa34002e000 comp rx=0 tx=0).stop 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3501550b0 msgr2=0x7fa3501f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3501550b0 0x7fa3501f4bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00d860 tx=0x7fa34c00dd20 comp rx=0 tx=0).stop 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 shutdown_connections 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33406c2e0 0x7fa33406e7a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa35015d030 0x7fa350148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa350155490 0x7fa3501e62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 --2- 172.21.15.103:0/3302642215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3501550b0 0x7fa3501f4bd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 >> 172.21.15.103:0/3302642215 conn(0x7fa35006c240 msgr2=0x7fa350153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 shutdown_connections 2024-09-19T05:38:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.817+0000 7fa35847b640 1 -- 172.21.15.103:0/3302642215 wait complete. 2024-09-19T05:38:03.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:38:03.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.930+0000 7fa833447640 1 Processor -- start 2024-09-19T05:38:03.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.930+0000 7fa833447640 1 -- start start 2024-09-19T05:38:03.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.931+0000 7fa833447640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c0c8a20 0x7fa82c0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.931+0000 7fa833447640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa82c15b0b0 0x7fa82c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.931+0000 7fa833447640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c1596c0 con 0x7fa82c151d80 2024-09-19T05:38:03.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.931+0000 7fa833447640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c0c9e70 con 0x7fa82c15b0b0 2024-09-19T05:38:03.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.931+0000 7fa833447640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c06f9d0 con 0x7fa82c0c8a20 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8309e2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c0c8a20 0x7fa82c0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8319e4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa82c15b0b0 0x7fa82c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8309e2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c0c8a20 0x7fa82c0c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46418/0 (socket says 172.21.15.103:46418) 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8309e2640 1 -- 172.21.15.103:0/2558391239 learned_addr learned my addr 172.21.15.103:0/2558391239 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8309e2640 1 -- 172.21.15.103:0/2558391239 >> v2:172.21.15.174:3300/0 conn(0x7fa82c15b0b0 msgr2=0x7fa82c15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8309e2640 1 --2- 172.21.15.103:0/2558391239 >> v2:172.21.15.174:3300/0 conn(0x7fa82c15b0b0 0x7fa82c15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8309e2640 1 -- 172.21.15.103:0/2558391239 >> v1:172.21.15.174:6789/0 conn(0x7fa82c151d80 legacy=0x7fa82c158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.932+0000 7fa8309e2640 1 -- 172.21.15.103:0/2558391239 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c06fcb0 con 0x7fa82c0c8a20 2024-09-19T05:38:03.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.933+0000 7fa8309e2640 1 --2- 172.21.15.103:0/2558391239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c0c8a20 0x7fa82c0c8e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b920 tx=0x7fa82002a780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d2d81eb58a58dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.933+0000 7fa82bfff640 1 -- 172.21.15.103:0/2558391239 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820037070 con 0x7fa82c0c8a20 2024-09-19T05:38:03.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.933+0000 7fa82bfff640 1 -- 172.21.15.103:0/2558391239 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82002f6b0 con 0x7fa82c0c8a20 2024-09-19T05:38:03.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.933+0000 7fa82bfff640 1 -- 172.21.15.103:0/2558391239 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82002fa80 con 0x7fa82c0c8a20 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 -- 172.21.15.103:0/2558391239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c0c8a20 msgr2=0x7fa82c0c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 --2- 172.21.15.103:0/2558391239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c0c8a20 0x7fa82c0c8e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b920 tx=0x7fa82002a780 comp rx=0 tx=0).stop 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 -- 172.21.15.103:0/2558391239 shutdown_connections 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 --2- 172.21.15.103:0/2558391239 >> v2:172.21.15.174:3300/0 conn(0x7fa82c15b0b0 0x7fa82c15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 --2- 172.21.15.103:0/2558391239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c0c8a20 0x7fa82c0c8e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 -- 172.21.15.103:0/2558391239 >> 172.21.15.103:0/2558391239 conn(0x7fa82c0ca140 msgr2=0x7fa82c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 -- 172.21.15.103:0/2558391239 shutdown_connections 2024-09-19T05:38:03.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.934+0000 7fa833447640 1 -- 172.21.15.103:0/2558391239 wait complete. 2024-09-19T05:38:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.935+0000 7fa833447640 1 Processor -- start 2024-09-19T05:38:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.935+0000 7fa833447640 1 -- start start 2024-09-19T05:38:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.935+0000 7fa833447640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa82c0c8a20 0x7fa82c0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.935+0000 7fa833447640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa82c151d80 0x7fa82c1efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa833447640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c15b0b0 0x7fa82c1499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa833447640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c070550 con 0x7fa82c0c8a20 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa833447640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c070270 con 0x7fa82c151d80 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa833447640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c070830 con 0x7fa82c15b0b0 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa82c0c8a20 0x7fa82c0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa82c0c8a20 0x7fa82c0c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46040/0 (socket says 172.21.15.103:46040) 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 -- 172.21.15.103:0/4009503912 learned_addr learned my addr 172.21.15.103:0/4009503912 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8319e4640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c15b0b0 0x7fa82c1499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8309e2640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa82c151d80 0x7fa82c1efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 -- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c15b0b0 msgr2=0x7fa82c1499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c15b0b0 0x7fa82c1499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 -- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa82c151d80 msgr2=0x7fa82c1efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa82c151d80 0x7fa82c1efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 -- 172.21.15.103:0/4009503912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c14e050 con 0x7fa82c0c8a20 2024-09-19T05:38:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa8311e3640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa82c0c8a20 0x7fa82c0c6160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c7c0 tx=0x7fa81c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa829ffb640 1 -- 172.21.15.103:0/4009503912 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c016020 con 0x7fa82c0c8a20 2024-09-19T05:38:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa829ffb640 1 -- 172.21.15.103:0/4009503912 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81c006d50 con 0x7fa82c0c8a20 2024-09-19T05:38:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c073a80 con 0x7fa82c0c8a20 2024-09-19T05:38:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.936+0000 7fa829ffb640 1 -- 172.21.15.103:0/4009503912 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c003bb0 con 0x7fa82c0c8a20 2024-09-19T05:38:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.937+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c14dd70 con 0x7fa82c0c8a20 2024-09-19T05:38:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.937+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c070d50 con 0x7fa82c0c8a20 2024-09-19T05:38:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.938+0000 7fa829ffb640 1 -- 172.21.15.103:0/4009503912 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa81c00a850 con 0x7fa82c0c8a20 2024-09-19T05:38:03.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.938+0000 7fa829ffb640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa81806c2e0 0x7fa81806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:03.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.938+0000 7fa829ffb640 1 -- 172.21.15.103:0/4009503912 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa81c08b2a0 con 0x7fa82c0c8a20 2024-09-19T05:38:03.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.938+0000 7fa8309e2640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa81806c2e0 0x7fa81806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:03.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.939+0000 7fa8309e2640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa81806c2e0 0x7fa81806e7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa820034000 tx=0x7fa82002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:03.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:03.943+0000 7fa829ffb640 1 -- 172.21.15.103:0/4009503912 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa81c020020 con 0x7fa82c0c8a20 2024-09-19T05:38:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.143+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa82c1e0f50 con 0x7fa82c0c8a20 2024-09-19T05:38:04.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.867+0000 7fa829ffb640 1 -- 172.21.15.103:0/4009503912 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa81c08b0c0 con 0x7fa82c0c8a20 2024-09-19T05:38:04.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa81806c2e0 msgr2=0x7fa81806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa81806c2e0 0x7fa81806e7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa820034000 tx=0x7fa82002e000 comp rx=0 tx=0).stop 2024-09-19T05:38:04.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa82c0c8a20 msgr2=0x7fa82c0c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa82c0c8a20 0x7fa82c0c6160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c7c0 tx=0x7fa81c00cc80 comp rx=0 tx=0).stop 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 shutdown_connections 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa81806c2e0 0x7fa81806e7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa82c15b0b0 0x7fa82c1499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa82c151d80 0x7fa82c1efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 --2- 172.21.15.103:0/4009503912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa82c0c8a20 0x7fa82c0c6160 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 >> 172.21.15.103:0/4009503912 conn(0x7fa82c0ca140 msgr2=0x7fa82c072a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 shutdown_connections 2024-09-19T05:38:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.870+0000 7fa833447640 1 -- 172.21.15.103:0/4009503912 wait complete. 2024-09-19T05:38:04.884 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-09-19T05:38:04.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-09-19T05:38:04.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.990+0000 7f7620918640 1 Processor -- start 2024-09-19T05:38:04.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.990+0000 7f7620918640 1 -- start start 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7620918640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7620918640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f761c070d60 0x7f761c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7620918640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f761c0cbf50 con 0x7f761c0683b0 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7620918640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f761c15bd30 con 0x7f761c070d60 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7620918640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f761c0cb410 con 0x7f761c154fb0 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761a59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7611d9b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f761c070d60 0x7f761c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761a59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c15b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46434/0 (socket says 172.21.15.103:46434) 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761ad9d640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f761c0683b0 0x7f761c073c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:53972/0 (socket says 172.21.15.103:53972) 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761a59c640 1 -- 172.21.15.103:0/1643651026 learned_addr learned my addr 172.21.15.103:0/1643651026 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:04.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761a59c640 1 -- 172.21.15.103:0/1643651026 >> v2:172.21.15.174:3300/0 conn(0x7f761c070d60 msgr2=0x7f761c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:04.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761a59c640 1 --2- 172.21.15.103:0/1643651026 >> v2:172.21.15.174:3300/0 conn(0x7f761c070d60 0x7f761c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761a59c640 1 -- 172.21.15.103:0/1643651026 >> v1:172.21.15.174:6789/0 conn(0x7f761c0683b0 legacy=0x7f761c073c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7619d9b640 1 -- 172.21.15.103:0/1643651026 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761718826 0 0) 0x7f761c0cbf50 con 0x7f761c0683b0 2024-09-19T05:38:04.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f761a59c640 1 -- 172.21.15.103:0/1643651026 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c0cb6b0 con 0x7f761c154fb0 2024-09-19T05:38:04.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.991+0000 7f7611d9b640 1 --2- 172.21.15.103:0/1643651026 >> v2:172.21.15.174:3300/0 conn(0x7f761c070d60 0x7f761c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:04.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.992+0000 7f761a59c640 1 --2- 172.21.15.103:0/1643651026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c15b7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f760c009870 tx=0x7f760c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ccb8d479c3dc9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:04.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.992+0000 7f7619d9b640 1 -- 172.21.15.103:0/1643651026 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c037070 con 0x7f761c154fb0 2024-09-19T05:38:04.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.992+0000 7f7619d9b640 1 -- 172.21.15.103:0/1643651026 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c032440 con 0x7f761c154fb0 2024-09-19T05:38:04.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.992+0000 7f7619d9b640 1 -- 172.21.15.103:0/1643651026 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c032810 con 0x7f761c154fb0 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 -- 172.21.15.103:0/1643651026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 msgr2=0x7f761c15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 --2- 172.21.15.103:0/1643651026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c15b7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f760c009870 tx=0x7f760c02a1c0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 -- 172.21.15.103:0/1643651026 shutdown_connections 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 --2- 172.21.15.103:0/1643651026 >> v2:172.21.15.174:3300/0 conn(0x7f761c070d60 0x7f761c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 --2- 172.21.15.103:0/1643651026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c15b7f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 -- 172.21.15.103:0/1643651026 >> 172.21.15.103:0/1643651026 conn(0x7f761c067890 msgr2=0x7f761c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 -- 172.21.15.103:0/1643651026 shutdown_connections 2024-09-19T05:38:04.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.993+0000 7f7620918640 1 -- 172.21.15.103:0/1643651026 wait complete. 2024-09-19T05:38:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 Processor -- start 2024-09-19T05:38:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 -- start start 2024-09-19T05:38:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f761c0683b0 0x7f761c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761c070d60 0x7f761c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f761c155390 con 0x7f761c0683b0 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f761c0cbc70 con 0x7f761c070d60 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f7620918640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f761c155510 con 0x7f761c154fb0 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f761a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f761c0683b0 0x7f761c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f761a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f761c0683b0 0x7f761c15a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46054/0 (socket says 172.21.15.103:46054) 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.995+0000 7f761a59c640 1 -- 172.21.15.103:0/1595252016 learned_addr learned my addr 172.21.15.103:0/1595252016 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f7611d9b640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761c070d60 0x7f761c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f761ad9d640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f761a59c640 1 -- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 msgr2=0x7f761c1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f761a59c640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f761a59c640 1 -- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761c070d60 msgr2=0x7f761c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f761a59c640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761c070d60 0x7f761c0cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f761a59c640 1 -- 172.21.15.103:0/1595252016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c159ac0 con 0x7f761c0683b0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f761a59c640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f761c0683b0 0x7f761c15a530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f760c035040 tx=0x7f760c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f76137fe640 1 -- 172.21.15.103:0/1595252016 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c037040 con 0x7f761c0683b0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f76137fe640 1 -- 172.21.15.103:0/1595252016 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c004230 con 0x7f761c0683b0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f76137fe640 1 -- 172.21.15.103:0/1595252016 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c003610 con 0x7f761c0683b0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761c157920 con 0x7f761c0683b0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.996+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761c15a010 con 0x7f761c0683b0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.997+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761c15b7f0 con 0x7f761c0683b0 2024-09-19T05:38:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.998+0000 7f76137fe640 1 -- 172.21.15.103:0/1595252016 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f760c02ad10 con 0x7f761c0683b0 2024-09-19T05:38:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.998+0000 7f76137fe640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.998+0000 7f76137fe640 1 -- 172.21.15.103:0/1595252016 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f760c0ac250 con 0x7f761c0683b0 2024-09-19T05:38:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.998+0000 7f7611d9b640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:04.999+0000 7f7611d9b640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75fc06c2b0 0x7f75fc06e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f761c0ca290 tx=0x7f7604008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.003+0000 7f76137fe640 1 -- 172.21.15.103:0/1595252016 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f760c07a830 con 0x7f761c0683b0 2024-09-19T05:38:05.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.206+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f761c15a1e0 con 0x7f761c0683b0 2024-09-19T05:38:05.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.868+0000 7f76137fe640 1 -- 172.21.15.103:0/1595252016 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f760c07a130 con 0x7f761c0683b0 2024-09-19T05:38:05.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.871+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75fc06c2b0 msgr2=0x7f75fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75fc06c2b0 0x7f75fc06e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f761c0ca290 tx=0x7f7604008040 comp rx=0 tx=0).stop 2024-09-19T05:38:05.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f761c0683b0 msgr2=0x7f761c15a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f761c0683b0 0x7f761c15a530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f760c035040 tx=0x7f760c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 shutdown_connections 2024-09-19T05:38:05.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761c154fb0 0x7f761c1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761c070d60 0x7f761c0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 --2- 172.21.15.103:0/1595252016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f761c0683b0 0x7f761c15a530 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 >> 172.21.15.103:0/1595252016 conn(0x7f761c067890 msgr2=0x7f761c0c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:05.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 shutdown_connections 2024-09-19T05:38:05.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.872+0000 7f7620918640 1 -- 172.21.15.103:0/1595252016 wait complete. 2024-09-19T05:38:05.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T05:38:05.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.989+0000 7f23b25cf640 1 Processor -- start 2024-09-19T05:38:05.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.989+0000 7f23b25cf640 1 -- start start 2024-09-19T05:38:05.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23b25cf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23ac154fb0 0x7f23ac15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23b25cf640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23ac070d60 0x7f23ac06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23b25cf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 0x7f23ac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23b25cf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f23ac15bd30 con 0x7f23ac154fb0 2024-09-19T05:38:05.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23b25cf640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f23ac0cbf50 con 0x7f23ac070d60 2024-09-19T05:38:05.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23b25cf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac0cb410 con 0x7f23ac0683b0 2024-09-19T05:38:05.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23ac154fb0 0x7f23ac15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23ac154fb0 0x7f23ac15b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46068/0 (socket says 172.21.15.103:46068) 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 -- 172.21.15.103:0/3939463524 learned_addr learned my addr 172.21.15.103:0/3939463524 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 -- 172.21.15.103:0/3939463524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 msgr2=0x7f23ac06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 --2- 172.21.15.103:0/3939463524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 0x7f23ac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 -- 172.21.15.103:0/3939463524 >> v2:172.21.15.174:3300/0 conn(0x7f23ac070d60 msgr2=0x7f23ac06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23ab7fe640 1 --2- 172.21.15.103:0/3939463524 >> v2:172.21.15.174:3300/0 conn(0x7f23ac070d60 0x7f23ac06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 --2- 172.21.15.103:0/3939463524 >> v2:172.21.15.174:3300/0 conn(0x7f23ac070d60 0x7f23ac06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23abfff640 1 -- 172.21.15.103:0/3939463524 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac0cb6b0 con 0x7f23ac154fb0 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.990+0000 7f23ab7fe640 1 --2- 172.21.15.103:0/3939463524 >> v2:172.21.15.174:3300/0 conn(0x7f23ac070d60 0x7f23ac06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:05.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.991+0000 7f23abfff640 1 --2- 172.21.15.103:0/3939463524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac154fb0 0x7f23ac15b7f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23ac075f30 tx=0x7f239c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8630a7be2fe90c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:05.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.991+0000 7f23aaffd640 1 -- 172.21.15.103:0/3939463524 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c037070 con 0x7f23ac154fb0 2024-09-19T05:38:05.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.991+0000 7f23aaffd640 1 -- 172.21.15.103:0/3939463524 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239c032440 con 0x7f23ac154fb0 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.991+0000 7f23aaffd640 1 -- 172.21.15.103:0/3939463524 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c032810 con 0x7f23ac154fb0 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 -- 172.21.15.103:0/3939463524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac154fb0 msgr2=0x7f23ac15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 --2- 172.21.15.103:0/3939463524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac154fb0 0x7f23ac15b7f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23ac075f30 tx=0x7f239c02a140 comp rx=0 tx=0).stop 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 -- 172.21.15.103:0/3939463524 shutdown_connections 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 --2- 172.21.15.103:0/3939463524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 0x7f23ac06d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 --2- 172.21.15.103:0/3939463524 >> v2:172.21.15.174:3300/0 conn(0x7f23ac070d60 0x7f23ac06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 --2- 172.21.15.103:0/3939463524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac154fb0 0x7f23ac15b7f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 -- 172.21.15.103:0/3939463524 >> 172.21.15.103:0/3939463524 conn(0x7f23ac067890 msgr2=0x7f23ac067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 -- 172.21.15.103:0/3939463524 shutdown_connections 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.992+0000 7f23b25cf640 1 -- 172.21.15.103:0/3939463524 wait complete. 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.993+0000 7f23b25cf640 1 Processor -- start 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.993+0000 7f23b25cf640 1 -- start start 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23b25cf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 0x7f23ac158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23b25cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac070d60 0x7f23ac1f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23b25cf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23ac154fb0 0x7f23ac1f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23b25cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac155390 con 0x7f23ac070d60 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23b25cf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac0cbc70 con 0x7f23ac154fb0 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23b25cf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac155510 con 0x7f23ac0683b0 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac070d60 0x7f23ac1f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac070d60 0x7f23ac1f0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46076/0 (socket says 172.21.15.103:46076) 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 -- 172.21.15.103:0/2240282860 learned_addr learned my addr 172.21.15.103:0/2240282860 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23b0b6c640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23ac154fb0 0x7f23ac1f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23abfff640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 0x7f23ac158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 -- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 msgr2=0x7f23ac158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 0x7f23ac158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 -- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23ac154fb0 msgr2=0x7f23ac1f0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23ac154fb0 0x7f23ac1f0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 -- 172.21.15.103:0/2240282860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac14e180 con 0x7f23ac070d60 2024-09-19T05:38:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.994+0000 7f23ab7fe640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac070d60 0x7f23ac1f0940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c7f0 tx=0x7f23a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.995+0000 7f23a8ff9640 1 -- 172.21.15.103:0/2240282860 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0015070 con 0x7f23ac070d60 2024-09-19T05:38:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.995+0000 7f23a8ff9640 1 -- 172.21.15.103:0/2240282860 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a0007820 con 0x7f23ac070d60 2024-09-19T05:38:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.995+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac14dea0 con 0x7f23ac070d60 2024-09-19T05:38:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.995+0000 7f23a8ff9640 1 -- 172.21.15.103:0/2240282860 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0007bd0 con 0x7f23ac070d60 2024-09-19T05:38:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.995+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac1e1450 con 0x7f23ac070d60 2024-09-19T05:38:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.996+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac15b7f0 con 0x7f23ac070d60 2024-09-19T05:38:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.996+0000 7f23a8ff9640 1 -- 172.21.15.103:0/2240282860 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23a0018070 con 0x7f23ac070d60 2024-09-19T05:38:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.996+0000 7f23a8ff9640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f239806c2b0 0x7f239806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.996+0000 7f23a8ff9640 1 -- 172.21.15.103:0/2240282860 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f23a008b730 con 0x7f23ac070d60 2024-09-19T05:38:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.997+0000 7f23abfff640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f239806c2b0 0x7f239806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:05.997+0000 7f23abfff640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f239806c2b0 0x7f239806e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f239c034000 tx=0x7f239c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.001+0000 7f23a8ff9640 1 -- 172.21.15.103:0/2240282860 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f23a00595a0 con 0x7f23ac070d60 2024-09-19T05:38:06.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.207+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f23ac0c9550 con 0x7f23ac070d60 2024-09-19T05:38:06.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.878+0000 7f23a8ff9640 1 -- 172.21.15.103:0/2240282860 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f23a005d8a0 con 0x7f23ac070d60 2024-09-19T05:38:06.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f239806c2b0 msgr2=0x7f239806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f239806c2b0 0x7f239806e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f239c034000 tx=0x7f239c02e000 comp rx=0 tx=0).stop 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac070d60 msgr2=0x7f23ac1f0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac070d60 0x7f23ac1f0940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c7f0 tx=0x7f23a000ccb0 comp rx=0 tx=0).stop 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 shutdown_connections 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f239806c2b0 0x7f239806e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23ac154fb0 0x7f23ac1f0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ac070d60 0x7f23ac1f0940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 --2- 172.21.15.103:0/2240282860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23ac0683b0 0x7f23ac158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 >> 172.21.15.103:0/2240282860 conn(0x7f23ac067890 msgr2=0x7f23ac1539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 shutdown_connections 2024-09-19T05:38:06.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.880+0000 7f23b25cf640 1 -- 172.21.15.103:0/2240282860 wait complete. 2024-09-19T05:38:06.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-19T05:38:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.996+0000 7f3fa1311640 1 Processor -- start 2024-09-19T05:38:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.996+0000 7f3fa1311640 1 -- start start 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3fa1311640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f9c0cc9c0 0x7f3f9c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3fa1311640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3fa1311640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f9c0cc0d0 con 0x7f3f9c154f30 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3fa1311640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3f9c0cbe80 con 0x7f3f9c0cc9c0 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3fa1311640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c0ccdf0 con 0x7f3f9c06e0c0 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f927fc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f9c0cc9c0 0x7f3f9c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f9b7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f9affd640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3f9c154f30 0x7f3f9c15ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:53984/0 (socket says 172.21.15.103:53984) 2024-09-19T05:38:06.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f927fc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f9c0cc9c0 0x7f3f9c06db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34528/0 (socket says 172.21.15.103:34528) 2024-09-19T05:38:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f9affd640 1 -- 172.21.15.103:0/1542524461 learned_addr learned my addr 172.21.15.103:0/1542524461 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f927fc640 1 -- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 msgr2=0x7f3f9c15ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f927fc640 1 --2- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c15ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f927fc640 1 -- 172.21.15.103:0/1542524461 >> v1:172.21.15.174:6789/0 conn(0x7f3f9c154f30 legacy=0x7f3f9c15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f927fc640 1 -- 172.21.15.103:0/1542524461 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c0cc3b0 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.997+0000 7f3f9b7fe640 1 --2- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c15ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.998+0000 7f3f927fc640 1 --2- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c06db80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f840097a0 tx=0x7f3f8402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882a40387b15d10c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.998+0000 7f3f9a7fc640 1 -- 172.21.15.103:0/1542524461 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84037070 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.998+0000 7f3f9a7fc640 1 -- 172.21.15.103:0/1542524461 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f84032440 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.998+0000 7f3f9a7fc640 1 -- 172.21.15.103:0/1542524461 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84032810 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 -- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 msgr2=0x7f3f9c06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 --2- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c06db80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f840097a0 tx=0x7f3f8402a210 comp rx=0 tx=0).stop 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 -- 172.21.15.103:0/1542524461 shutdown_connections 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 --2- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c15ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 --2- 172.21.15.103:0/1542524461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c06db80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 -- 172.21.15.103:0/1542524461 >> 172.21.15.103:0/1542524461 conn(0x7f3f9c06bd10 msgr2=0x7f3f9c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 -- 172.21.15.103:0/1542524461 shutdown_connections 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:06.999+0000 7f3fa1311640 1 -- 172.21.15.103:0/1542524461 wait complete. 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.000+0000 7f3fa1311640 1 Processor -- start 2024-09-19T05:38:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.000+0000 7f3fa1311640 1 -- start start 2024-09-19T05:38:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3fa1311640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c1f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3fa1311640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3fa1311640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f9c154f30 0x7f3f9c14e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3fa1311640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c0b3590 con 0x7f3f9c154f30 2024-09-19T05:38:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3fa1311640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c0cb590 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3fa1311640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c155310 con 0x7f3f9c06e0c0 2024-09-19T05:38:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3f9b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f9c154f30 0x7f3f9c14e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3f9b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f9c154f30 0x7f3f9c14e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46090/0 (socket says 172.21.15.103:46090) 2024-09-19T05:38:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3f9b7fe640 1 -- 172.21.15.103:0/3370686806 learned_addr learned my addr 172.21.15.103:0/3370686806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3f9affd640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c1f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.001+0000 7f3f927fc640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f927fc640 1 -- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 msgr2=0x7f3f9c1f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f927fc640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c1f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f927fc640 1 -- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f9c154f30 msgr2=0x7f3f9c14e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f927fc640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f9c154f30 0x7f3f9c14e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f927fc640 1 -- 172.21.15.103:0/3370686806 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c0b5c90 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f9b7fe640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f9c154f30 0x7f3f9c14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f927fc640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c159e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f84031000 tx=0x7f3f840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f93fff640 1 -- 172.21.15.103:0/3370686806 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84041030 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f93fff640 1 -- 172.21.15.103:0/3370686806 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f84030500 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9c0cec10 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3f93fff640 1 -- 172.21.15.103:0/3370686806 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84037040 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.002+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9c0b5f10 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.003+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9c06db80 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.003+0000 7f3f93fff640 1 -- 172.21.15.103:0/3370686806 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f84044070 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.004+0000 7f3f93fff640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f7c06c2b0 0x7f3f7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.004+0000 7f3f93fff640 1 -- 172.21.15.103:0/3370686806 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3f840ab9b0 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.004+0000 7f3f9affd640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f7c06c2b0 0x7f3f7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.004+0000 7f3f9affd640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f7c06c2b0 0x7f3f7c06e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c000f60 tx=0x7f3f8c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.009+0000 7f3f93fff640 1 -- 172.21.15.103:0/3370686806 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3f9c0b5c90 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.211+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3f9c0cbc60 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.882+0000 7f3f93fff640 1 -- 172.21.15.103:0/3370686806 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f3f84079780 con 0x7f3f9c0cc9c0 2024-09-19T05:38:07.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.884+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f7c06c2b0 msgr2=0x7f3f7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.884+0000 7f3fa1311640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f7c06c2b0 0x7f3f7c06e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c000f60 tx=0x7f3f8c007e80 comp rx=0 tx=0).stop 2024-09-19T05:38:07.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.884+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 msgr2=0x7f3f9c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:07.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.884+0000 7f3fa1311640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c159e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f84031000 tx=0x7f3f840046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 shutdown_connections 2024-09-19T05:38:07.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f7c06c2b0 0x7f3f7c06e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f9c154f30 0x7f3f9c14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f9c0cc9c0 0x7f3f9c159e30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 --2- 172.21.15.103:0/3370686806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9c06e0c0 0x7f3f9c1f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:07.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 >> 172.21.15.103:0/3370686806 conn(0x7f3f9c06bd10 msgr2=0x7f3f9c06c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:07.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 shutdown_connections 2024-09-19T05:38:07.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.885+0000 7f3fa1311640 1 -- 172.21.15.103:0/3370686806 wait complete. 2024-09-19T05:38:07.898 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T05:38:07.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:07.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.997+0000 7f5068b8d640 1 Processor -- start 2024-09-19T05:38:07.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.997+0000 7f5068b8d640 1 -- start start 2024-09-19T05:38:08.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f5068b8d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f506415af30 0x7f50640c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f5068b8d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5064070700 0x7f50640c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f5068b8d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50641556c0 con 0x7f50641552e0 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f5068b8d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f50640c82d0 con 0x7f506415af30 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f5068b8d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f506415b3e0 con 0x7f5064070700 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f506259c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50641552e0 0x7f506406fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53334/0 (socket says 172.21.15.103:53334) 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f506259c640 1 -- 172.21.15.103:0/2919126759 learned_addr learned my addr 172.21.15.103:0/2919126759 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.998+0000 7f5061d9b640 1 --2- 172.21.15.103:0/2919126759 >> v2:172.21.15.103:3300/0 conn(0x7f506415af30 0x7f50640c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f5062d9d640 1 --2- 172.21.15.103:0/2919126759 >> v2:172.21.15.174:3300/0 conn(0x7f5064070700 0x7f50640c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f506159a640 1 -- 172.21.15.103:0/2919126759 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100246327 0 0) 0x7f5054001490 con 0x7f50641552e0 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f506159a640 1 -- 172.21.15.103:0/2919126759 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f504c003520 con 0x7f50641552e0 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f5061d9b640 1 -- 172.21.15.103:0/2919126759 >> v2:172.21.15.174:3300/0 conn(0x7f5064070700 msgr2=0x7f50640c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f5061d9b640 1 --2- 172.21.15.103:0/2919126759 >> v2:172.21.15.174:3300/0 conn(0x7f5064070700 0x7f50640c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f5061d9b640 1 -- 172.21.15.103:0/2919126759 >> v1:172.21.15.103:6789/0 conn(0x7f50641552e0 legacy=0x7f506406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f5061d9b640 1 -- 172.21.15.103:0/2919126759 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506415b6c0 con 0x7f506415af30 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f5061d9b640 1 --2- 172.21.15.103:0/2919126759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f506415af30 0x7f50640c9290 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f506406f6a0 tx=0x7f505802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c78fa474327522 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:07.999+0000 7f506159a640 1 -- 172.21.15.103:0/2919126759 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058037070 con 0x7f506415af30 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f506159a640 1 -- 172.21.15.103:0/2919126759 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5058032440 con 0x7f506415af30 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f506159a640 1 -- 172.21.15.103:0/2919126759 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580327f0 con 0x7f506415af30 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 -- 172.21.15.103:0/2919126759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f506415af30 msgr2=0x7f50640c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2919126759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f506415af30 0x7f50640c9290 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f506406f6a0 tx=0x7f505802a1a0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 -- 172.21.15.103:0/2919126759 shutdown_connections 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2919126759 >> v2:172.21.15.174:3300/0 conn(0x7f5064070700 0x7f50640c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2919126759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f506415af30 0x7f50640c9290 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 -- 172.21.15.103:0/2919126759 >> 172.21.15.103:0/2919126759 conn(0x7f50640ca140 msgr2=0x7f50640ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 -- 172.21.15.103:0/2919126759 shutdown_connections 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.000+0000 7f5068b8d640 1 -- 172.21.15.103:0/2919126759 wait complete. 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.001+0000 7f5068b8d640 1 Processor -- start 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5068b8d640 1 -- start start 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5068b8d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5064070700 0x7f50641f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5068b8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50641552e0 0x7f506414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5068b8d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f506415af30 0x7f506414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5068b8d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f506406fad0 con 0x7f50641552e0 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5068b8d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f506415bc80 con 0x7f506415af30 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5068b8d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f50640c9d10 con 0x7f5064070700 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5061d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50641552e0 0x7f506414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5061d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50641552e0 0x7f506414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46106/0 (socket says 172.21.15.103:46106) 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.002+0000 7f5061d9b640 1 -- 172.21.15.103:0/2041568828 learned_addr learned my addr 172.21.15.103:0/2041568828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5062d9d640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f506415af30 0x7f506414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5061d9b640 1 -- 172.21.15.103:0/2041568828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5064070700 msgr2=0x7f50641f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5061d9b640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5064070700 0x7f50641f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5061d9b640 1 -- 172.21.15.103:0/2041568828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f506415af30 msgr2=0x7f506414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5061d9b640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f506415af30 0x7f506414aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5061d9b640 1 -- 172.21.15.103:0/2041568828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50641586c0 con 0x7f50641552e0 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5061d9b640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50641552e0 0x7f506414dd90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f505802a1e0 tx=0x7f50580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5052ffd640 1 -- 172.21.15.103:0/2041568828 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058037040 con 0x7f50641552e0 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5052ffd640 1 -- 172.21.15.103:0/2041568828 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50580304c0 con 0x7f50641552e0 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50641f4e30 con 0x7f50641552e0 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5052ffd640 1 -- 172.21.15.103:0/2041568828 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058030890 con 0x7f50641552e0 2024-09-19T05:38:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.003+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506414d590 con 0x7f50641552e0 2024-09-19T05:38:08.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.004+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50640c8cd0 con 0x7f50641552e0 2024-09-19T05:38:08.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.004+0000 7f5052ffd640 1 -- 172.21.15.103:0/2041568828 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5058044020 con 0x7f50641552e0 2024-09-19T05:38:08.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.005+0000 7f5052ffd640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f504406c2b0 0x7f504406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.005+0000 7f5052ffd640 1 -- 172.21.15.103:0/2041568828 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f50580abaf0 con 0x7f50641552e0 2024-09-19T05:38:08.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.005+0000 7f506259c640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f504406c2b0 0x7f504406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.005+0000 7f506259c640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f504406c2b0 0x7f504406e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50540012e0 tx=0x7f5054001490 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.009+0000 7f5052ffd640 1 -- 172.21.15.103:0/2041568828 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5058079f20 con 0x7f50641552e0 2024-09-19T05:38:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.207+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50640c8040 con 0x7f50641552e0 2024-09-19T05:38:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.208+0000 7f5052ffd640 1 -- 172.21.15.103:0/2041568828 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6898 (secure 0 0 0) 0x7f5058079820 con 0x7f50641552e0 2024-09-19T05:38:08.210 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:08.210 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-19T05:38:07:878548+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:07.212598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4302,"mds_1":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-09-19T05:38:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f504406c2b0 msgr2=0x7f504406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f504406c2b0 0x7f504406e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50540012e0 tx=0x7f5054001490 comp rx=0 tx=0).stop 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50641552e0 msgr2=0x7f506414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50641552e0 0x7f506414dd90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f505802a1e0 tx=0x7f50580046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 shutdown_connections 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f504406c2b0 0x7f504406e770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f506415af30 0x7f506414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50641552e0 0x7f506414dd90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 --2- 172.21.15.103:0/2041568828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5064070700 0x7f50641f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 >> 172.21.15.103:0/2041568828 conn(0x7f50640ca140 msgr2=0x7f50640ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 shutdown_connections 2024-09-19T05:38:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.210+0000 7f5068b8d640 1 -- 172.21.15.103:0/2041568828 wait complete. 2024-09-19T05:38:08.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.320+0000 7f3f3a786640 1 Processor -- start 2024-09-19T05:38:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.320+0000 7f3f3a786640 1 -- start start 2024-09-19T05:38:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.321+0000 7f3f3a786640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f340c5950 0x7f3f340cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.321+0000 7f3f3a786640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f340cbed0 con 0x7f3f340b3540 2024-09-19T05:38:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.321+0000 7f3f3a786640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3415bd70 con 0x7f3f34155040 2024-09-19T05:38:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.321+0000 7f3f3a786640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3f340cbbf0 con 0x7f3f340c5950 2024-09-19T05:38:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.321+0000 7f3f337fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3f340b3540 0x7f3f340cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53344/0 (socket says 172.21.15.103:53344) 2024-09-19T05:38:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.321+0000 7f3f337fe640 1 -- 172.21.15.103:0/760451243 learned_addr learned my addr 172.21.15.103:0/760451243 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.321+0000 7f3f38d23640 1 --2- 172.21.15.103:0/760451243 >> v2:172.21.15.174:3300/0 conn(0x7f3f340c5950 0x7f3f340cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642602747 0 0) 0x7f3f340cbed0 con 0x7f3f340b3540 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f1c003520 con 0x7f3f340b3540 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168143297 0 0) 0x7f3f3415bd70 con 0x7f3f34155040 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f340cbed0 con 0x7f3f34155040 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2250637301 0 0) 0x7f3f1c003520 con 0x7f3f340b3540 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 >> v2:172.21.15.174:3300/0 conn(0x7f3f340c5950 msgr2=0x7f3f340cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 --2- 172.21.15.103:0/760451243 >> v2:172.21.15.174:3300/0 conn(0x7f3f340c5950 0x7f3f340cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 >> v1:172.21.15.174:6789/0 conn(0x7f3f34155040 legacy=0x7f3f3415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3415afb0 con 0x7f3f340b3540 2024-09-19T05:38:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f3f28001670 con 0x7f3f340b3540 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f38d23640 1 --2- 172.21.15.103:0/760451243 >> v2:172.21.15.174:3300/0 conn(0x7f3f340c5950 0x7f3f340cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 >> v1:172.21.15.103:6789/0 conn(0x7f3f340b3540 legacy=0x7f3f340cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f1c003b90 0x7f3f1c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c004800 0x7f3f1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f1c0051c0 0x7f3f1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340cbbf0 con 0x7f3f1c003b90 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c00bfe0 con 0x7f3f1c004800 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c00c1e0 con 0x7f3f1c0051c0 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f33fff640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f1c003b90 0x7f3f1c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f337fe640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c004800 0x7f3f1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f38d23640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f1c0051c0 0x7f3f1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f33fff640 1 -- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f1c0051c0 msgr2=0x7f3f1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f33fff640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f1c0051c0 0x7f3f1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f33fff640 1 -- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c004800 msgr2=0x7f3f1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f33fff640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c004800 0x7f3f1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f33fff640 1 -- 172.21.15.103:0/760451243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c003520 con 0x7f3f1c003b90 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f38d23640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f1c0051c0 0x7f3f1c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.322+0000 7f3f38d23640 1 -- 172.21.15.103:0/760451243 reap_dead start 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.323+0000 7f3f33fff640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f1c003b90 0x7f3f1c003f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f240018d0 tx=0x7f3f1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6774cbca2c0cf8c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.323+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f240014f0 con 0x7f3f1c003b90 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.323+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f240052d0 con 0x7f3f1c003b90 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.323+0000 7f3f32ffd640 1 -- 172.21.15.103:0/760451243 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2402ac40 con 0x7f3f1c003b90 2024-09-19T05:38:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.324+0000 7f3f3a786640 1 -- 172.21.15.103:0/760451243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f1c003b90 msgr2=0x7f3f1c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.324+0000 7f3f3a786640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f1c003b90 0x7f3f1c003f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f240018d0 tx=0x7f3f1c005830 comp rx=0 tx=0).stop 2024-09-19T05:38:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.324+0000 7f3f3a786640 1 -- 172.21.15.103:0/760451243 shutdown_connections 2024-09-19T05:38:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.324+0000 7f3f3a786640 1 --2- 172.21.15.103:0/760451243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f1c003b90 0x7f3f1c003f90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.324+0000 7f3f3a786640 1 -- 172.21.15.103:0/760451243 >> 172.21.15.103:0/760451243 conn(0x7f3f34073340 msgr2=0x7f3f34073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.324+0000 7f3f3a786640 1 -- 172.21.15.103:0/760451243 shutdown_connections 2024-09-19T05:38:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.324+0000 7f3f3a786640 1 -- 172.21.15.103:0/760451243 wait complete. 2024-09-19T05:38:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.325+0000 7f3f3a786640 1 Processor -- start 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.325+0000 7f3f3a786640 1 -- start start 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f3a786640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c003b90 0x7f3f341e5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f3a786640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f3414f150 0x7f3f3414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f3a786640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f3414d690 0x7f3f3414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f3a786640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3415b850 con 0x7f3f3414d690 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f3a786640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3415b570 con 0x7f3f1c003b90 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f3a786640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3f340cb540 con 0x7f3f3414f150 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f3414d690 0x7f3f3414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f3414d690 0x7f3f3414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46124/0 (socket says 172.21.15.103:46124) 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 -- 172.21.15.103:0/3608160392 learned_addr learned my addr 172.21.15.103:0/3608160392 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f33fff640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c003b90 0x7f3f341e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f337fe640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f3414f150 0x7f3f3414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 -- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f3414f150 msgr2=0x7f3f3414f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f3414f150 0x7f3f3414f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 -- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c003b90 msgr2=0x7f3f341e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c003b90 0x7f3f341e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 -- 172.21.15.103:0/3608160392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f340cf990 con 0x7f3f3414d690 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f337fe640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f3414f150 0x7f3f3414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.326+0000 7f3f38d23640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f3414d690 0x7f3f3414db10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f34068390 tx=0x7f3f2c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.327+0000 7f3f30ff9640 1 -- 172.21.15.103:0/3608160392 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c003990 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.327+0000 7f3f30ff9640 1 -- 172.21.15.103:0/3608160392 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c01b070 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.327+0000 7f3f30ff9640 1 -- 172.21.15.103:0/3608160392 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c003b70 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.327+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3414c100 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.327+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f341f19a0 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.328+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f340cb8d0 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.328+0000 7f3f30ff9640 1 -- 172.21.15.103:0/3608160392 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f2c005d10 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.328+0000 7f3f30ff9640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f2006c2b0 0x7f3f2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.329+0000 7f3f30ff9640 1 -- 172.21.15.103:0/3608160392 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3f2c08bef0 con 0x7f3f3414d690 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.329+0000 7f3f33fff640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f2006c2b0 0x7f3f2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.329+0000 7f3f33fff640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f2006c2b0 0x7f3f2006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f24032000 tx=0x7f3f24009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.333+0000 7f3f30ff9640 1 -- 172.21.15.103:0/3608160392 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3f2c025020 con 0x7f3f3414d690 2024-09-19T05:38:08.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.498+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f340cfdb0 con 0x7f3f3414d690 2024-09-19T05:38:08.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.499+0000 7f3f30ff9640 1 -- 172.21.15.103:0/3608160392 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18670 (secure 0 0 0) 0x7f3f2c05a320 con 0x7f3f3414d690 2024-09-19T05:38:08.501 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:08.501 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:49.821955+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:08.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f2006c2b0 msgr2=0x7f3f2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f2006c2b0 0x7f3f2006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f24032000 tx=0x7f3f24009030 comp rx=0 tx=0).stop 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f3414d690 msgr2=0x7f3f3414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f3414d690 0x7f3f3414db10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f34068390 tx=0x7f3f2c0115a0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 shutdown_connections 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3f2006c2b0 0x7f3f2006e770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f3414d690 0x7f3f3414db10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f3414f150 0x7f3f3414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 --2- 172.21.15.103:0/3608160392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f1c003b90 0x7f3f341e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 >> 172.21.15.103:0/3608160392 conn(0x7f3f34073340 msgr2=0x7f3f341506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 shutdown_connections 2024-09-19T05:38:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.501+0000 7f3f3a786640 1 -- 172.21.15.103:0/3608160392 wait complete. 2024-09-19T05:38:08.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:38:08.514 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:08.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.611+0000 7fe76d931640 1 Processor -- start 2024-09-19T05:38:08.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.611+0000 7fe76d931640 1 -- start start 2024-09-19T05:38:08.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.611+0000 7fe76d931640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe7680cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.611+0000 7fe76d931640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7680cbed0 con 0x7fe7680b3540 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.611+0000 7fe76d931640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76815bd70 con 0x7fe7680c5950 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.611+0000 7fe76d931640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe7680cbbf0 con 0x7fe768155040 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe7667fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe7680b3540 0x7fe76815e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53354/0 (socket says 172.21.15.103:53354) 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe7667fc640 1 -- 172.21.15.103:0/3902996774 learned_addr learned my addr 172.21.15.103:0/3902996774 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe766ffd640 1 --2- 172.21.15.103:0/3902996774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe7680cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025545864 0 0) 0x7fe7680cbed0 con 0x7fe7680b3540 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe750003520 con 0x7fe7680b3540 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158193735 0 0) 0x7fe76815bd70 con 0x7fe7680c5950 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7680cbed0 con 0x7fe7680c5950 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 484717965 0 0) 0x7fe750003520 con 0x7fe7680b3540 2024-09-19T05:38:08.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe766ffd640 1 -- 172.21.15.103:0/3902996774 >> v1:172.21.15.174:6789/0 conn(0x7fe7680c5950 legacy=0x7fe7680cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe766ffd640 1 -- 172.21.15.103:0/3902996774 >> v1:172.21.15.103:6789/0 conn(0x7fe7680b3540 legacy=0x7fe76815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.612+0000 7fe766ffd640 1 -- 172.21.15.103:0/3902996774 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76815afb0 con 0x7fe768155040 2024-09-19T05:38:08.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.613+0000 7fe766ffd640 1 --2- 172.21.15.103:0/3902996774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe7680cb540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7580097d0 tx=0x7fe75802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d2ce95eea733de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.613+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758037070 con 0x7fe768155040 2024-09-19T05:38:08.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.613+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75802ac30 con 0x7fe768155040 2024-09-19T05:38:08.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.613+0000 7fe765ffb640 1 -- 172.21.15.103:0/3902996774 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c001670 con 0x7fe768155040 2024-09-19T05:38:08.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.613+0000 7fe76d931640 1 -- 172.21.15.103:0/3902996774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 msgr2=0x7fe7680cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.613+0000 7fe76d931640 1 --2- 172.21.15.103:0/3902996774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe7680cb540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7580097d0 tx=0x7fe75802a1a0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.614+0000 7fe76d931640 1 -- 172.21.15.103:0/3902996774 shutdown_connections 2024-09-19T05:38:08.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.614+0000 7fe76d931640 1 --2- 172.21.15.103:0/3902996774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe7680cb540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.614+0000 7fe76d931640 1 -- 172.21.15.103:0/3902996774 >> 172.21.15.103:0/3902996774 conn(0x7fe768073340 msgr2=0x7fe768073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.614+0000 7fe76d931640 1 -- 172.21.15.103:0/3902996774 shutdown_connections 2024-09-19T05:38:08.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.614+0000 7fe76d931640 1 -- 172.21.15.103:0/3902996774 wait complete. 2024-09-19T05:38:08.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 Processor -- start 2024-09-19T05:38:08.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 -- start start 2024-09-19T05:38:08.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7680b3540 0x7fe7680cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7680c5950 0x7fe7681590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe76815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe76815b850 con 0x7fe7680c5950 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe76815b570 con 0x7fe7680b3540 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.615+0000 7fe76d931640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe76815eb30 con 0x7fe768155040 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7680c5950 0x7fe7681590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7680c5950 0x7fe7681590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46130/0 (socket says 172.21.15.103:46130) 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 -- 172.21.15.103:0/1835583414 learned_addr learned my addr 172.21.15.103:0/1835583414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe766ffd640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7680b3540 0x7fe7680cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7677fe640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe76815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 -- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 msgr2=0x7fe76815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe76815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 -- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7680b3540 msgr2=0x7fe7680cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7680b3540 0x7fe7680cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 -- 172.21.15.103:0/1835583414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76815e1c0 con 0x7fe7680c5950 2024-09-19T05:38:08.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe7667fc640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7680c5950 0x7fe7681590c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c750 tx=0x7fe75c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe74ffff640 1 -- 172.21.15.103:0/1835583414 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c017070 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe74ffff640 1 -- 172.21.15.103:0/1835583414 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c005ad0 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe74ffff640 1 -- 172.21.15.103:0/1835583414 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c007070 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76815df00 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.616+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe768157a40 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.617+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7680c6df0 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.618+0000 7fe74ffff640 1 -- 172.21.15.103:0/1835583414 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe75c01a070 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.618+0000 7fe74ffff640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe75406c2e0 0x7fe75406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.618+0000 7fe766ffd640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe75406c2e0 0x7fe75406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.618+0000 7fe74ffff640 1 -- 172.21.15.103:0/1835583414 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe75c08aac0 con 0x7fe7680c5950 2024-09-19T05:38:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.619+0000 7fe766ffd640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe75406c2e0 0x7fe75406e7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe758034000 tx=0x7fe75802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.622+0000 7fe74ffff640 1 -- 172.21.15.103:0/1835583414 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe75c058930 con 0x7fe7680c5950 2024-09-19T05:38:08.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.785+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7680cb540 con 0x7fe75406c2e0 2024-09-19T05:38:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.793+0000 7fe74ffff640 1 -- 172.21.15.103:0/1835583414 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7fe7680cb540 con 0x7fe75406c2e0 2024-09-19T05:38:08.799 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:38:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe75406c2e0 msgr2=0x7fe75406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe75406c2e0 0x7fe75406e7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe758034000 tx=0x7fe75802e000 comp rx=0 tx=0).stop 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7680c5950 msgr2=0x7fe7681590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7680c5950 0x7fe7681590c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c750 tx=0x7fe75c00cc10 comp rx=0 tx=0).stop 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 shutdown_connections 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe75406c2e0 0x7fe75406e7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe768155040 0x7fe76815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7680c5950 0x7fe7681590c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 --2- 172.21.15.103:0/1835583414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7680b3540 0x7fe7680cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 >> 172.21.15.103:0/1835583414 conn(0x7fe768073340 msgr2=0x7fe768073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 shutdown_connections 2024-09-19T05:38:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.797+0000 7fe76d931640 1 -- 172.21.15.103:0/1835583414 wait complete. 2024-09-19T05:38:08.809 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-19T05:38:08.181854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218576,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756144,"statfs":{"total":773094113280,"available":772870291456,"internally_reserved":0,"allocated":2392064,"data_stored":2082308,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526146+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:37:50.526146+0000","last_peered":"2024-09-19T05:37:50.526146+0000","last_clean":"2024-09-19T05:37:50.526146+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:37:50.526146+0000","last_undegraded":"2024-09-19T05:37:50.526146+0000","last_fullsized":"2024-09-19T05:37:50.526146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830894+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:37:49.830894+0000","last_peered":"2024-09-19T05:37:49.830894+0000","last_clean":"2024-09-19T05:37:49.830894+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:37:49.830894+0000","last_undegraded":"2024-09-19T05:37:49.830894+0000","last_fullsized":"2024-09-19T05:37:49.830894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830981+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:37:49.830981+0000","last_peered":"2024-09-19T05:37:49.830981+0000","last_clean":"2024-09-19T05:37:49.830981+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:37:49.830981+0000","last_undegraded":"2024-09-19T05:37:49.830981+0000","last_fullsized":"2024-09-19T05:37:49.830981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525978+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:37:50.525978+0000","last_peered":"2024-09-19T05:37:50.525978+0000","last_clean":"2024-09-19T05:37:50.525978+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:37:50.525978+0000","last_undegraded":"2024-09-19T05:37:50.525978+0000","last_fullsized":"2024-09-19T05:37:50.525978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525568+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:37:50.525568+0000","last_peered":"2024-09-19T05:37:50.525568+0000","last_clean":"2024-09-19T05:37:50.525568+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:37:50.525568+0000","last_undegraded":"2024-09-19T05:37:50.525568+0000","last_fullsized":"2024-09-19T05:37:50.525568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526316+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:37:50.526316+0000","last_peered":"2024-09-19T05:37:50.526316+0000","last_clean":"2024-09-19T05:37:50.526316+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:37:50.526316+0000","last_undegraded":"2024-09-19T05:37:50.526316+0000","last_fullsized":"2024-09-19T05:37:50.526316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836803+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:37:49.836803+0000","last_peered":"2024-09-19T05:37:49.836803+0000","last_clean":"2024-09-19T05:37:49.836803+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:37:49.836803+0000","last_undegraded":"2024-09-19T05:37:49.836803+0000","last_fullsized":"2024-09-19T05:37:49.836803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525961+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:37:50.525961+0000","last_peered":"2024-09-19T05:37:50.525961+0000","last_clean":"2024-09-19T05:37:50.525961+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:37:50.525961+0000","last_undegraded":"2024-09-19T05:37:50.525961+0000","last_fullsized":"2024-09-19T05:37:50.525961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526008+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:37:50.526008+0000","last_peered":"2024-09-19T05:37:50.526008+0000","last_clean":"2024-09-19T05:37:50.526008+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:37:50.526008+0000","last_undegraded":"2024-09-19T05:37:50.526008+0000","last_fullsized":"2024-09-19T05:37:50.526008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836489+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:37:49.836489+0000","last_peered":"2024-09-19T05:37:49.836489+0000","last_clean":"2024-09-19T05:37:49.836489+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:37:49.836489+0000","last_undegraded":"2024-09-19T05:37:49.836489+0000","last_fullsized":"2024-09-19T05:37:49.836489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526194+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:37:50.526194+0000","last_peered":"2024-09-19T05:37:50.526194+0000","last_clean":"2024-09-19T05:37:50.526194+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:37:50.526194+0000","last_undegraded":"2024-09-19T05:37:50.526194+0000","last_fullsized":"2024-09-19T05:37:50.526194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836393+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:37:49.836393+0000","last_peered":"2024-09-19T05:37:49.836393+0000","last_clean":"2024-09-19T05:37:49.836393+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:37:49.836393+0000","last_undegraded":"2024-09-19T05:37:49.836393+0000","last_fullsized":"2024-09-19T05:37:49.836393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525923+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:37:50.525923+0000","last_peered":"2024-09-19T05:37:50.525923+0000","last_clean":"2024-09-19T05:37:50.525923+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:37:50.525923+0000","last_undegraded":"2024-09-19T05:37:50.525923+0000","last_fullsized":"2024-09-19T05:37:50.525923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527273+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:37:50.527273+0000","last_peered":"2024-09-19T05:37:50.527273+0000","last_clean":"2024-09-19T05:37:50.527273+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:37:50.527273+0000","last_undegraded":"2024-09-19T05:37:50.527273+0000","last_fullsized":"2024-09-19T05:37:50.527273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830473+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:37:49.830473+0000","last_peered":"2024-09-19T05:37:49.830473+0000","last_clean":"2024-09-19T05:37:49.830473+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:37:49.830473+0000","last_undegraded":"2024-09-19T05:37:49.830473+0000","last_fullsized":"2024-09-19T05:37:49.830473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526715+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:37:50.526715+0000","last_peered":"2024-09-19T05:37:50.526715+0000","last_clean":"2024-09-19T05:37:50.526715+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:37:50.526715+0000","last_undegraded":"2024-09-19T05:37:50.526715+0000","last_fullsized":"2024-09-19T05:37:50.526715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526929+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:37:50.526929+0000","last_peered":"2024-09-19T05:37:50.526929+0000","last_clean":"2024-09-19T05:37:50.526929+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:37:50.526929+0000","last_undegraded":"2024-09-19T05:37:50.526929+0000","last_fullsized":"2024-09-19T05:37:50.526929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830185+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:37:49.830185+0000","last_peered":"2024-09-19T05:37:49.830185+0000","last_clean":"2024-09-19T05:37:49.830185+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:37:49.830185+0000","last_undegraded":"2024-09-19T05:37:49.830185+0000","last_fullsized":"2024-09-19T05:37:49.830185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525802+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:37:50.525802+0000","last_peered":"2024-09-19T05:37:50.525802+0000","last_clean":"2024-09-19T05:37:50.525802+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:37:50.525802+0000","last_undegraded":"2024-09-19T05:37:50.525802+0000","last_fullsized":"2024-09-19T05:37:50.525802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526964+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:37:50.526964+0000","last_peered":"2024-09-19T05:37:50.526964+0000","last_clean":"2024-09-19T05:37:50.526964+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:37:50.526964+0000","last_undegraded":"2024-09-19T05:37:50.526964+0000","last_fullsized":"2024-09-19T05:37:50.526964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526748+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:37:50.526748+0000","last_peered":"2024-09-19T05:37:50.526748+0000","last_clean":"2024-09-19T05:37:50.526748+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:37:50.526748+0000","last_undegraded":"2024-09-19T05:37:50.526748+0000","last_fullsized":"2024-09-19T05:37:50.526748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525505+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:37:50.525505+0000","last_peered":"2024-09-19T05:37:50.525505+0000","last_clean":"2024-09-19T05:37:50.525505+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:37:50.525505+0000","last_undegraded":"2024-09-19T05:37:50.525505+0000","last_fullsized":"2024-09-19T05:37:50.525505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526205+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:37:50.526205+0000","last_peered":"2024-09-19T05:37:50.526205+0000","last_clean":"2024-09-19T05:37:50.526205+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:37:50.526205+0000","last_undegraded":"2024-09-19T05:37:50.526205+0000","last_fullsized":"2024-09-19T05:37:50.526205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526013+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:37:50.526013+0000","last_peered":"2024-09-19T05:37:50.526013+0000","last_clean":"2024-09-19T05:37:50.526013+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:37:50.526013+0000","last_undegraded":"2024-09-19T05:37:50.526013+0000","last_fullsized":"2024-09-19T05:37:50.526013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.837005+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:37:49.837005+0000","last_peered":"2024-09-19T05:37:49.837005+0000","last_clean":"2024-09-19T05:37:49.837005+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:37:49.837005+0000","last_undegraded":"2024-09-19T05:37:49.837005+0000","last_fullsized":"2024-09-19T05:37:49.837005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526592+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:37:50.526592+0000","last_peered":"2024-09-19T05:37:50.526592+0000","last_clean":"2024-09-19T05:37:50.526592+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:37:50.526592+0000","last_undegraded":"2024-09-19T05:37:50.526592+0000","last_fullsized":"2024-09-19T05:37:50.526592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830955+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:37:49.830955+0000","last_peered":"2024-09-19T05:37:49.830955+0000","last_clean":"2024-09-19T05:37:49.830955+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:37:49.830955+0000","last_undegraded":"2024-09-19T05:37:49.830955+0000","last_fullsized":"2024-09-19T05:37:49.830955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526862+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:37:50.526862+0000","last_peered":"2024-09-19T05:37:50.526862+0000","last_clean":"2024-09-19T05:37:50.526862+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:37:50.526862+0000","last_undegraded":"2024-09-19T05:37:50.526862+0000","last_fullsized":"2024-09-19T05:37:50.526862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829936+0000","last_change":"2024-09-19T05:37:48.360604+0000","last_active":"2024-09-19T05:37:49.829936+0000","last_peered":"2024-09-19T05:37:49.829936+0000","last_clean":"2024-09-19T05:37:49.829936+0000","last_became_active":"2024-09-19T05:37:48.360142+0000","last_became_peered":"2024-09-19T05:37:48.360142+0000","last_unstale":"2024-09-19T05:37:49.829936+0000","last_undegraded":"2024-09-19T05:37:49.829936+0000","last_fullsized":"2024-09-19T05:37:49.829936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:52.762613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526855+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:37:50.526855+0000","last_peered":"2024-09-19T05:37:50.526855+0000","last_clean":"2024-09-19T05:37:50.526855+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:37:50.526855+0000","last_undegraded":"2024-09-19T05:37:50.526855+0000","last_fullsized":"2024-09-19T05:37:50.526855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526512+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:37:50.526512+0000","last_peered":"2024-09-19T05:37:50.526512+0000","last_clean":"2024-09-19T05:37:50.526512+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:37:50.526512+0000","last_undegraded":"2024-09-19T05:37:50.526512+0000","last_fullsized":"2024-09-19T05:37:50.526512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526178+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:37:50.526178+0000","last_peered":"2024-09-19T05:37:50.526178+0000","last_clean":"2024-09-19T05:37:50.526178+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:37:50.526178+0000","last_undegraded":"2024-09-19T05:37:50.526178+0000","last_fullsized":"2024-09-19T05:37:50.526178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836580+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:37:49.836580+0000","last_peered":"2024-09-19T05:37:49.836580+0000","last_clean":"2024-09-19T05:37:49.836580+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:37:49.836580+0000","last_undegraded":"2024-09-19T05:37:49.836580+0000","last_fullsized":"2024-09-19T05:37:49.836580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526879+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:37:50.526879+0000","last_peered":"2024-09-19T05:37:50.526879+0000","last_clean":"2024-09-19T05:37:50.526879+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:37:50.526879+0000","last_undegraded":"2024-09-19T05:37:50.526879+0000","last_fullsized":"2024-09-19T05:37:50.526879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526516+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:37:50.526516+0000","last_peered":"2024-09-19T05:37:50.526516+0000","last_clean":"2024-09-19T05:37:50.526516+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:37:50.526516+0000","last_undegraded":"2024-09-19T05:37:50.526516+0000","last_fullsized":"2024-09-19T05:37:50.526516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526515+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:37:50.526515+0000","last_peered":"2024-09-19T05:37:50.526515+0000","last_clean":"2024-09-19T05:37:50.526515+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:37:50.526515+0000","last_undegraded":"2024-09-19T05:37:50.526515+0000","last_fullsized":"2024-09-19T05:37:50.526515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836809+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:37:49.836809+0000","last_peered":"2024-09-19T05:37:49.836809+0000","last_clean":"2024-09-19T05:37:49.836809+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:37:49.836809+0000","last_undegraded":"2024-09-19T05:37:49.836809+0000","last_fullsized":"2024-09-19T05:37:49.836809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526796+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:37:50.526796+0000","last_peered":"2024-09-19T05:37:50.526796+0000","last_clean":"2024-09-19T05:37:50.526796+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:37:50.526796+0000","last_undegraded":"2024-09-19T05:37:50.526796+0000","last_fullsized":"2024-09-19T05:37:50.526796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525410+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:37:50.525410+0000","last_peered":"2024-09-19T05:37:50.525410+0000","last_clean":"2024-09-19T05:37:50.525410+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:37:50.525410+0000","last_undegraded":"2024-09-19T05:37:50.525410+0000","last_fullsized":"2024-09-19T05:37:50.525410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525365+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:37:50.525365+0000","last_peered":"2024-09-19T05:37:50.525365+0000","last_clean":"2024-09-19T05:37:50.525365+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:37:50.525365+0000","last_undegraded":"2024-09-19T05:37:50.525365+0000","last_fullsized":"2024-09-19T05:37:50.525365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526961+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:37:50.526961+0000","last_peered":"2024-09-19T05:37:50.526961+0000","last_clean":"2024-09-19T05:37:50.526961+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:37:50.526961+0000","last_undegraded":"2024-09-19T05:37:50.526961+0000","last_fullsized":"2024-09-19T05:37:50.526961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525663+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:37:50.525663+0000","last_peered":"2024-09-19T05:37:50.525663+0000","last_clean":"2024-09-19T05:37:50.525663+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:37:50.525663+0000","last_undegraded":"2024-09-19T05:37:50.525663+0000","last_fullsized":"2024-09-19T05:37:50.525663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525493+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:37:50.525493+0000","last_peered":"2024-09-19T05:37:50.525493+0000","last_clean":"2024-09-19T05:37:50.525493+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:37:50.525493+0000","last_undegraded":"2024-09-19T05:37:50.525493+0000","last_fullsized":"2024-09-19T05:37:50.525493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525931+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:37:50.525931+0000","last_peered":"2024-09-19T05:37:50.525931+0000","last_clean":"2024-09-19T05:37:50.525931+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:37:50.525931+0000","last_undegraded":"2024-09-19T05:37:50.525931+0000","last_fullsized":"2024-09-19T05:37:50.525931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830243+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:37:49.830243+0000","last_peered":"2024-09-19T05:37:49.830243+0000","last_clean":"2024-09-19T05:37:49.830243+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:37:49.830243+0000","last_undegraded":"2024-09-19T05:37:49.830243+0000","last_fullsized":"2024-09-19T05:37:49.830243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836107+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:37:49.836107+0000","last_peered":"2024-09-19T05:37:49.836107+0000","last_clean":"2024-09-19T05:37:49.836107+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:37:49.836107+0000","last_undegraded":"2024-09-19T05:37:49.836107+0000","last_fullsized":"2024-09-19T05:37:49.836107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525629+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:37:50.525629+0000","last_peered":"2024-09-19T05:37:50.525629+0000","last_clean":"2024-09-19T05:37:50.525629+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:37:50.525629+0000","last_undegraded":"2024-09-19T05:37:50.525629+0000","last_fullsized":"2024-09-19T05:37:50.525629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836135+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:37:49.836135+0000","last_peered":"2024-09-19T05:37:49.836135+0000","last_clean":"2024-09-19T05:37:49.836135+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:37:49.836135+0000","last_undegraded":"2024-09-19T05:37:49.836135+0000","last_fullsized":"2024-09-19T05:37:49.836135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526130+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:37:50.526130+0000","last_peered":"2024-09-19T05:37:50.526130+0000","last_clean":"2024-09-19T05:37:50.526130+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:37:50.526130+0000","last_undegraded":"2024-09-19T05:37:50.526130+0000","last_fullsized":"2024-09-19T05:37:50.526130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525763+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:37:50.525763+0000","last_peered":"2024-09-19T05:37:50.525763+0000","last_clean":"2024-09-19T05:37:50.525763+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:37:50.525763+0000","last_undegraded":"2024-09-19T05:37:50.525763+0000","last_fullsized":"2024-09-19T05:37:50.525763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836366+0000","last_change":"2024-09-19T05:37:48.360455+0000","last_active":"2024-09-19T05:37:49.836366+0000","last_peered":"2024-09-19T05:37:49.836366+0000","last_clean":"2024-09-19T05:37:49.836366+0000","last_became_active":"2024-09-19T05:37:48.360015+0000","last_became_peered":"2024-09-19T05:37:48.360015+0000","last_unstale":"2024-09-19T05:37:49.836366+0000","last_undegraded":"2024-09-19T05:37:49.836366+0000","last_fullsized":"2024-09-19T05:37:49.836366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:58.281260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836248+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:37:49.836248+0000","last_peered":"2024-09-19T05:37:49.836248+0000","last_clean":"2024-09-19T05:37:49.836248+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:37:49.836248+0000","last_undegraded":"2024-09-19T05:37:49.836248+0000","last_fullsized":"2024-09-19T05:37:49.836248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526377+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:37:50.526377+0000","last_peered":"2024-09-19T05:37:50.526377+0000","last_clean":"2024-09-19T05:37:50.526377+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:37:50.526377+0000","last_undegraded":"2024-09-19T05:37:50.526377+0000","last_fullsized":"2024-09-19T05:37:50.526377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526335+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:37:50.526335+0000","last_peered":"2024-09-19T05:37:50.526335+0000","last_clean":"2024-09-19T05:37:50.526335+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:37:50.526335+0000","last_undegraded":"2024-09-19T05:37:50.526335+0000","last_fullsized":"2024-09-19T05:37:50.526335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526501+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:37:50.526501+0000","last_peered":"2024-09-19T05:37:50.526501+0000","last_clean":"2024-09-19T05:37:50.526501+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:37:50.526501+0000","last_undegraded":"2024-09-19T05:37:50.526501+0000","last_fullsized":"2024-09-19T05:37:50.526501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525419+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:37:50.525419+0000","last_peered":"2024-09-19T05:37:50.525419+0000","last_clean":"2024-09-19T05:37:50.525419+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:37:50.525419+0000","last_undegraded":"2024-09-19T05:37:50.525419+0000","last_fullsized":"2024-09-19T05:37:50.525419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835474+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:37:49.835474+0000","last_peered":"2024-09-19T05:37:49.835474+0000","last_clean":"2024-09-19T05:37:49.835474+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:37:49.835474+0000","last_undegraded":"2024-09-19T05:37:49.835474+0000","last_fullsized":"2024-09-19T05:37:49.835474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526347+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:37:50.526347+0000","last_peered":"2024-09-19T05:37:50.526347+0000","last_clean":"2024-09-19T05:37:50.526347+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:37:50.526347+0000","last_undegraded":"2024-09-19T05:37:50.526347+0000","last_fullsized":"2024-09-19T05:37:50.526347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526647+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:37:50.526647+0000","last_peered":"2024-09-19T05:37:50.526647+0000","last_clean":"2024-09-19T05:37:50.526647+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:37:50.526647+0000","last_undegraded":"2024-09-19T05:37:50.526647+0000","last_fullsized":"2024-09-19T05:37:50.526647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525843+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:37:50.525843+0000","last_peered":"2024-09-19T05:37:50.525843+0000","last_clean":"2024-09-19T05:37:50.525843+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:37:50.525843+0000","last_undegraded":"2024-09-19T05:37:50.525843+0000","last_fullsized":"2024-09-19T05:37:50.525843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525805+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:37:50.525805+0000","last_peered":"2024-09-19T05:37:50.525805+0000","last_clean":"2024-09-19T05:37:50.525805+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:37:50.525805+0000","last_undegraded":"2024-09-19T05:37:50.525805+0000","last_fullsized":"2024-09-19T05:37:50.525805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525050+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:37:50.525050+0000","last_peered":"2024-09-19T05:37:50.525050+0000","last_clean":"2024-09-19T05:37:50.525050+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:37:50.525050+0000","last_undegraded":"2024-09-19T05:37:50.525050+0000","last_fullsized":"2024-09-19T05:37:50.525050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525789+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:37:50.525789+0000","last_peered":"2024-09-19T05:37:50.525789+0000","last_clean":"2024-09-19T05:37:50.525789+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:37:50.525789+0000","last_undegraded":"2024-09-19T05:37:50.525789+0000","last_fullsized":"2024-09-19T05:37:50.525789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836113+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:37:49.836113+0000","last_peered":"2024-09-19T05:37:49.836113+0000","last_clean":"2024-09-19T05:37:49.836113+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:37:49.836113+0000","last_undegraded":"2024-09-19T05:37:49.836113+0000","last_fullsized":"2024-09-19T05:37:49.836113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836182+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:37:49.836182+0000","last_peered":"2024-09-19T05:37:49.836182+0000","last_clean":"2024-09-19T05:37:49.836182+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:37:49.836182+0000","last_undegraded":"2024-09-19T05:37:49.836182+0000","last_fullsized":"2024-09-19T05:37:49.836182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830874+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:37:49.830874+0000","last_peered":"2024-09-19T05:37:49.830874+0000","last_clean":"2024-09-19T05:37:49.830874+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:37:49.830874+0000","last_undegraded":"2024-09-19T05:37:49.830874+0000","last_fullsized":"2024-09-19T05:37:49.830874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525857+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:37:50.525857+0000","last_peered":"2024-09-19T05:37:50.525857+0000","last_clean":"2024-09-19T05:37:50.525857+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:37:50.525857+0000","last_undegraded":"2024-09-19T05:37:50.525857+0000","last_fullsized":"2024-09-19T05:37:50.525857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836806+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:37:49.836806+0000","last_peered":"2024-09-19T05:37:49.836806+0000","last_clean":"2024-09-19T05:37:49.836806+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:37:49.836806+0000","last_undegraded":"2024-09-19T05:37:49.836806+0000","last_fullsized":"2024-09-19T05:37:49.836806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830313+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:37:49.830313+0000","last_peered":"2024-09-19T05:37:49.830313+0000","last_clean":"2024-09-19T05:37:49.830313+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:37:49.830313+0000","last_undegraded":"2024-09-19T05:37:49.830313+0000","last_fullsized":"2024-09-19T05:37:49.830313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525852+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:37:50.525852+0000","last_peered":"2024-09-19T05:37:50.525852+0000","last_clean":"2024-09-19T05:37:50.525852+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:37:50.525852+0000","last_undegraded":"2024-09-19T05:37:50.525852+0000","last_fullsized":"2024-09-19T05:37:50.525852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526451+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:37:50.526451+0000","last_peered":"2024-09-19T05:37:50.526451+0000","last_clean":"2024-09-19T05:37:50.526451+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:37:50.526451+0000","last_undegraded":"2024-09-19T05:37:50.526451+0000","last_fullsized":"2024-09-19T05:37:50.526451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836390+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:37:49.836390+0000","last_peered":"2024-09-19T05:37:49.836390+0000","last_clean":"2024-09-19T05:37:49.836390+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:37:49.836390+0000","last_undegraded":"2024-09-19T05:37:49.836390+0000","last_fullsized":"2024-09-19T05:37:49.836390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526036+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:37:50.526036+0000","last_peered":"2024-09-19T05:37:50.526036+0000","last_clean":"2024-09-19T05:37:50.526036+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:37:50.526036+0000","last_undegraded":"2024-09-19T05:37:50.526036+0000","last_fullsized":"2024-09-19T05:37:50.526036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:56.304759+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:37:56.304759+0000","last_peered":"2024-09-19T05:37:56.304759+0000","last_clean":"2024-09-19T05:37:56.304759+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:37:56.304759+0000","last_undegraded":"2024-09-19T05:37:56.304759+0000","last_fullsized":"2024-09-19T05:37:56.304759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526654+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:37:50.526654+0000","last_peered":"2024-09-19T05:37:50.526654+0000","last_clean":"2024-09-19T05:37:50.526654+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:37:50.526654+0000","last_undegraded":"2024-09-19T05:37:50.526654+0000","last_fullsized":"2024-09-19T05:37:50.526654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527026+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:37:50.527026+0000","last_peered":"2024-09-19T05:37:50.527026+0000","last_clean":"2024-09-19T05:37:50.527026+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:37:50.527026+0000","last_undegraded":"2024-09-19T05:37:50.527026+0000","last_fullsized":"2024-09-19T05:37:50.527026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526407+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:37:50.526407+0000","last_peered":"2024-09-19T05:37:50.526407+0000","last_clean":"2024-09-19T05:37:50.526407+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:37:50.526407+0000","last_undegraded":"2024-09-19T05:37:50.526407+0000","last_fullsized":"2024-09-19T05:37:50.526407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526199+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:37:50.526199+0000","last_peered":"2024-09-19T05:37:50.526199+0000","last_clean":"2024-09-19T05:37:50.526199+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:37:50.526199+0000","last_undegraded":"2024-09-19T05:37:50.526199+0000","last_fullsized":"2024-09-19T05:37:50.526199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526059+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:37:50.526059+0000","last_peered":"2024-09-19T05:37:50.526059+0000","last_clean":"2024-09-19T05:37:50.526059+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:37:50.526059+0000","last_undegraded":"2024-09-19T05:37:50.526059+0000","last_fullsized":"2024-09-19T05:37:50.526059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836248+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:37:49.836248+0000","last_peered":"2024-09-19T05:37:49.836248+0000","last_clean":"2024-09-19T05:37:49.836248+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:37:49.836248+0000","last_undegraded":"2024-09-19T05:37:49.836248+0000","last_fullsized":"2024-09-19T05:37:49.836248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830099+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:37:49.830099+0000","last_peered":"2024-09-19T05:37:49.830099+0000","last_clean":"2024-09-19T05:37:49.830099+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:37:49.830099+0000","last_undegraded":"2024-09-19T05:37:49.830099+0000","last_fullsized":"2024-09-19T05:37:49.830099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836270+0000","last_change":"2024-09-19T05:37:43.798426+0000","last_active":"2024-09-19T05:37:49.836270+0000","last_peered":"2024-09-19T05:37:49.836270+0000","last_clean":"2024-09-19T05:37:49.836270+0000","last_became_active":"2024-09-19T05:37:43.797575+0000","last_became_peered":"2024-09-19T05:37:43.797575+0000","last_unstale":"2024-09-19T05:37:49.836270+0000","last_undegraded":"2024-09-19T05:37:49.836270+0000","last_fullsized":"2024-09-19T05:37:49.836270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:07.139397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836919+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:37:49.836919+0000","last_peered":"2024-09-19T05:37:49.836919+0000","last_clean":"2024-09-19T05:37:49.836919+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:37:49.836919+0000","last_undegraded":"2024-09-19T05:37:49.836919+0000","last_fullsized":"2024-09-19T05:37:49.836919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830059+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:37:49.830059+0000","last_peered":"2024-09-19T05:37:49.830059+0000","last_clean":"2024-09-19T05:37:49.830059+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:37:49.830059+0000","last_undegraded":"2024-09-19T05:37:49.830059+0000","last_fullsized":"2024-09-19T05:37:49.830059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525638+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:37:50.525638+0000","last_peered":"2024-09-19T05:37:50.525638+0000","last_clean":"2024-09-19T05:37:50.525638+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:37:50.525638+0000","last_undegraded":"2024-09-19T05:37:50.525638+0000","last_fullsized":"2024-09-19T05:37:50.525638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525626+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:37:50.525626+0000","last_peered":"2024-09-19T05:37:50.525626+0000","last_clean":"2024-09-19T05:37:50.525626+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:37:50.525626+0000","last_undegraded":"2024-09-19T05:37:50.525626+0000","last_fullsized":"2024-09-19T05:37:50.525626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835612+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:37:49.835612+0000","last_peered":"2024-09-19T05:37:49.835612+0000","last_clean":"2024-09-19T05:37:49.835612+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:37:49.835612+0000","last_undegraded":"2024-09-19T05:37:49.835612+0000","last_fullsized":"2024-09-19T05:37:49.835612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836846+0000","last_change":"2024-09-19T05:37:47.808596+0000","last_active":"2024-09-19T05:37:49.836846+0000","last_peered":"2024-09-19T05:37:49.836846+0000","last_clean":"2024-09-19T05:37:49.836846+0000","last_became_active":"2024-09-19T05:37:47.808169+0000","last_became_peered":"2024-09-19T05:37:47.808169+0000","last_unstale":"2024-09-19T05:37:49.836846+0000","last_undegraded":"2024-09-19T05:37:49.836846+0000","last_fullsized":"2024-09-19T05:37:49.836846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:44.137286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830088+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:37:49.830088+0000","last_peered":"2024-09-19T05:37:49.830088+0000","last_clean":"2024-09-19T05:37:49.830088+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:37:49.830088+0000","last_undegraded":"2024-09-19T05:37:49.830088+0000","last_fullsized":"2024-09-19T05:37:49.830088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830275+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:37:49.830275+0000","last_peered":"2024-09-19T05:37:49.830275+0000","last_clean":"2024-09-19T05:37:49.830275+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:37:49.830275+0000","last_undegraded":"2024-09-19T05:37:49.830275+0000","last_fullsized":"2024-09-19T05:37:49.830275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836491+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:37:49.836491+0000","last_peered":"2024-09-19T05:37:49.836491+0000","last_clean":"2024-09-19T05:37:49.836491+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:37:49.836491+0000","last_undegraded":"2024-09-19T05:37:49.836491+0000","last_fullsized":"2024-09-19T05:37:49.836491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526741+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:37:50.526741+0000","last_peered":"2024-09-19T05:37:50.526741+0000","last_clean":"2024-09-19T05:37:50.526741+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:37:50.526741+0000","last_undegraded":"2024-09-19T05:37:50.526741+0000","last_fullsized":"2024-09-19T05:37:50.526741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525558+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:37:50.525558+0000","last_peered":"2024-09-19T05:37:50.525558+0000","last_clean":"2024-09-19T05:37:50.525558+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:37:50.525558+0000","last_undegraded":"2024-09-19T05:37:50.525558+0000","last_fullsized":"2024-09-19T05:37:50.525558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830617+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:37:49.830617+0000","last_peered":"2024-09-19T05:37:49.830617+0000","last_clean":"2024-09-19T05:37:49.830617+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:37:49.830617+0000","last_undegraded":"2024-09-19T05:37:49.830617+0000","last_fullsized":"2024-09-19T05:37:49.830617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526434+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:37:50.526434+0000","last_peered":"2024-09-19T05:37:50.526434+0000","last_clean":"2024-09-19T05:37:50.526434+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:37:50.526434+0000","last_undegraded":"2024-09-19T05:37:50.526434+0000","last_fullsized":"2024-09-19T05:37:50.526434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830768+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:37:49.830768+0000","last_peered":"2024-09-19T05:37:49.830768+0000","last_clean":"2024-09-19T05:37:49.830768+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:37:49.830768+0000","last_undegraded":"2024-09-19T05:37:49.830768+0000","last_fullsized":"2024-09-19T05:37:49.830768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835869+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:37:49.835869+0000","last_peered":"2024-09-19T05:37:49.835869+0000","last_clean":"2024-09-19T05:37:49.835869+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:37:49.835869+0000","last_undegraded":"2024-09-19T05:37:49.835869+0000","last_fullsized":"2024-09-19T05:37:49.835869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525234+0000","last_change":"2024-09-19T05:37:43.791626+0000","last_active":"2024-09-19T05:37:50.525234+0000","last_peered":"2024-09-19T05:37:50.525234+0000","last_clean":"2024-09-19T05:37:50.525234+0000","last_became_active":"2024-09-19T05:37:43.791176+0000","last_became_peered":"2024-09-19T05:37:43.791176+0000","last_unstale":"2024-09-19T05:37:50.525234+0000","last_undegraded":"2024-09-19T05:37:50.525234+0000","last_fullsized":"2024-09-19T05:37:50.525234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:30.947341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836714+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:37:49.836714+0000","last_peered":"2024-09-19T05:37:49.836714+0000","last_clean":"2024-09-19T05:37:49.836714+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:37:49.836714+0000","last_undegraded":"2024-09-19T05:37:49.836714+0000","last_fullsized":"2024-09-19T05:37:49.836714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526338+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:37:50.526338+0000","last_peered":"2024-09-19T05:37:50.526338+0000","last_clean":"2024-09-19T05:37:50.526338+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:37:50.526338+0000","last_undegraded":"2024-09-19T05:37:50.526338+0000","last_fullsized":"2024-09-19T05:37:50.526338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830471+0000","last_change":"2024-09-19T05:37:43.795638+0000","last_active":"2024-09-19T05:37:49.830471+0000","last_peered":"2024-09-19T05:37:49.830471+0000","last_clean":"2024-09-19T05:37:49.830471+0000","last_became_active":"2024-09-19T05:37:43.795360+0000","last_became_peered":"2024-09-19T05:37:43.795360+0000","last_unstale":"2024-09-19T05:37:49.830471+0000","last_undegraded":"2024-09-19T05:37:49.830471+0000","last_fullsized":"2024-09-19T05:37:49.830471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:08.525535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526265+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:37:50.526265+0000","last_peered":"2024-09-19T05:37:50.526265+0000","last_clean":"2024-09-19T05:37:50.526265+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:37:50.526265+0000","last_undegraded":"2024-09-19T05:37:50.526265+0000","last_fullsized":"2024-09-19T05:37:50.526265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836748+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:37:49.836748+0000","last_peered":"2024-09-19T05:37:49.836748+0000","last_clean":"2024-09-19T05:37:49.836748+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:37:49.836748+0000","last_undegraded":"2024-09-19T05:37:49.836748+0000","last_fullsized":"2024-09-19T05:37:49.836748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830871+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:37:49.830871+0000","last_peered":"2024-09-19T05:37:49.830871+0000","last_clean":"2024-09-19T05:37:49.830871+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:37:49.830871+0000","last_undegraded":"2024-09-19T05:37:49.830871+0000","last_fullsized":"2024-09-19T05:37:49.830871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835569+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:37:49.835569+0000","last_peered":"2024-09-19T05:37:49.835569+0000","last_clean":"2024-09-19T05:37:49.835569+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:37:49.835569+0000","last_undegraded":"2024-09-19T05:37:49.835569+0000","last_fullsized":"2024-09-19T05:37:49.835569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830198+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:37:49.830198+0000","last_peered":"2024-09-19T05:37:49.830198+0000","last_clean":"2024-09-19T05:37:49.830198+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:37:49.830198+0000","last_undegraded":"2024-09-19T05:37:49.830198+0000","last_fullsized":"2024-09-19T05:37:49.830198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836658+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:37:49.836658+0000","last_peered":"2024-09-19T05:37:49.836658+0000","last_clean":"2024-09-19T05:37:49.836658+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:37:49.836658+0000","last_undegraded":"2024-09-19T05:37:49.836658+0000","last_fullsized":"2024-09-19T05:37:49.836658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526251+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:37:50.526251+0000","last_peered":"2024-09-19T05:37:50.526251+0000","last_clean":"2024-09-19T05:37:50.526251+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:37:50.526251+0000","last_undegraded":"2024-09-19T05:37:50.526251+0000","last_fullsized":"2024-09-19T05:37:50.526251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836668+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:37:49.836668+0000","last_peered":"2024-09-19T05:37:49.836668+0000","last_clean":"2024-09-19T05:37:49.836668+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:37:49.836668+0000","last_undegraded":"2024-09-19T05:37:49.836668+0000","last_fullsized":"2024-09-19T05:37:49.836668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526418+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:37:50.526418+0000","last_peered":"2024-09-19T05:37:50.526418+0000","last_clean":"2024-09-19T05:37:50.526418+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:37:50.526418+0000","last_undegraded":"2024-09-19T05:37:50.526418+0000","last_fullsized":"2024-09-19T05:37:50.526418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525330+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:37:50.525330+0000","last_peered":"2024-09-19T05:37:50.525330+0000","last_clean":"2024-09-19T05:37:50.525330+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:37:50.525330+0000","last_undegraded":"2024-09-19T05:37:50.525330+0000","last_fullsized":"2024-09-19T05:37:50.525330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836515+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:37:49.836515+0000","last_peered":"2024-09-19T05:37:49.836515+0000","last_clean":"2024-09-19T05:37:49.836515+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:37:49.836515+0000","last_undegraded":"2024-09-19T05:37:49.836515+0000","last_fullsized":"2024-09-19T05:37:49.836515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835454+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:37:49.835454+0000","last_peered":"2024-09-19T05:37:49.835454+0000","last_clean":"2024-09-19T05:37:49.835454+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:37:49.835454+0000","last_undegraded":"2024-09-19T05:37:49.835454+0000","last_fullsized":"2024-09-19T05:37:49.835454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525715+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:37:50.525715+0000","last_peered":"2024-09-19T05:37:50.525715+0000","last_clean":"2024-09-19T05:37:50.525715+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:37:50.525715+0000","last_undegraded":"2024-09-19T05:37:50.525715+0000","last_fullsized":"2024-09-19T05:37:50.525715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525756+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:37:50.525756+0000","last_peered":"2024-09-19T05:37:50.525756+0000","last_clean":"2024-09-19T05:37:50.525756+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:37:50.525756+0000","last_undegraded":"2024-09-19T05:37:50.525756+0000","last_fullsized":"2024-09-19T05:37:50.525756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830450+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:37:49.830450+0000","last_peered":"2024-09-19T05:37:49.830450+0000","last_clean":"2024-09-19T05:37:49.830450+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:37:49.830450+0000","last_undegraded":"2024-09-19T05:37:49.830450+0000","last_fullsized":"2024-09-19T05:37:49.830450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526998+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:37:50.526998+0000","last_peered":"2024-09-19T05:37:50.526998+0000","last_clean":"2024-09-19T05:37:50.526998+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:37:50.526998+0000","last_undegraded":"2024-09-19T05:37:50.526998+0000","last_fullsized":"2024-09-19T05:37:50.526998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836290+0000","last_change":"2024-09-19T05:37:43.798142+0000","last_active":"2024-09-19T05:37:49.836290+0000","last_peered":"2024-09-19T05:37:49.836290+0000","last_clean":"2024-09-19T05:37:49.836290+0000","last_became_active":"2024-09-19T05:37:43.797843+0000","last_became_peered":"2024-09-19T05:37:43.797843+0000","last_unstale":"2024-09-19T05:37:49.836290+0000","last_undegraded":"2024-09-19T05:37:49.836290+0000","last_fullsized":"2024-09-19T05:37:49.836290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:02.764951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836653+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:37:49.836653+0000","last_peered":"2024-09-19T05:37:49.836653+0000","last_clean":"2024-09-19T05:37:49.836653+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:37:49.836653+0000","last_undegraded":"2024-09-19T05:37:49.836653+0000","last_fullsized":"2024-09-19T05:37:49.836653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526498+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:37:50.526498+0000","last_peered":"2024-09-19T05:37:50.526498+0000","last_clean":"2024-09-19T05:37:50.526498+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:37:50.526498+0000","last_undegraded":"2024-09-19T05:37:50.526498+0000","last_fullsized":"2024-09-19T05:37:50.526498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525773+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:37:50.525773+0000","last_peered":"2024-09-19T05:37:50.525773+0000","last_clean":"2024-09-19T05:37:50.525773+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:37:50.525773+0000","last_undegraded":"2024-09-19T05:37:50.525773+0000","last_fullsized":"2024-09-19T05:37:50.525773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836622+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:37:49.836622+0000","last_peered":"2024-09-19T05:37:49.836622+0000","last_clean":"2024-09-19T05:37:49.836622+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:37:49.836622+0000","last_undegraded":"2024-09-19T05:37:49.836622+0000","last_fullsized":"2024-09-19T05:37:49.836622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525795+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:37:50.525795+0000","last_peered":"2024-09-19T05:37:50.525795+0000","last_clean":"2024-09-19T05:37:50.525795+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:37:50.525795+0000","last_undegraded":"2024-09-19T05:37:50.525795+0000","last_fullsized":"2024-09-19T05:37:50.525795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836111+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:37:49.836111+0000","last_peered":"2024-09-19T05:37:49.836111+0000","last_clean":"2024-09-19T05:37:49.836111+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:37:49.836111+0000","last_undegraded":"2024-09-19T05:37:49.836111+0000","last_fullsized":"2024-09-19T05:37:49.836111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525884+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:37:50.525884+0000","last_peered":"2024-09-19T05:37:50.525884+0000","last_clean":"2024-09-19T05:37:50.525884+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:37:50.525884+0000","last_undegraded":"2024-09-19T05:37:50.525884+0000","last_fullsized":"2024-09-19T05:37:50.525884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526777+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:37:50.526777+0000","last_peered":"2024-09-19T05:37:50.526777+0000","last_clean":"2024-09-19T05:37:50.526777+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:37:50.526777+0000","last_undegraded":"2024-09-19T05:37:50.526777+0000","last_fullsized":"2024-09-19T05:37:50.526777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526294+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:37:50.526294+0000","last_peered":"2024-09-19T05:37:50.526294+0000","last_clean":"2024-09-19T05:37:50.526294+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:37:50.526294+0000","last_undegraded":"2024-09-19T05:37:50.526294+0000","last_fullsized":"2024-09-19T05:37:50.526294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":702486,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":115380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":111626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":115380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":111536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":702542,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:08.816 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.948+0000 7fedc1417640 1 Processor -- start 2024-09-19T05:38:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.948+0000 7fedc1417640 1 -- start start 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.948+0000 7fedc1417640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fedbc0b3540 0x7fedbc0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.948+0000 7fedc1417640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedbc0cbed0 con 0x7fedbc155040 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.948+0000 7fedc1417640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedbc15bd70 con 0x7fedbc0c5950 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.948+0000 7fedc1417640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fedbc0cbbf0 con 0x7fedbc0b3540 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedbaffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fedbc155040 0x7fedbc15e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53362/0 (socket says 172.21.15.103:53362) 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedbaffd640 1 -- 172.21.15.103:0/773186213 learned_addr learned my addr 172.21.15.103:0/773186213 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedba7fc640 1 --2- 172.21.15.103:0/773186213 >> v2:172.21.15.174:3300/0 conn(0x7fedbc0b3540 0x7fedbc0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106601686 0 0) 0x7fedbc0cbed0 con 0x7fedbc155040 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda4003520 con 0x7fedbc155040 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281389477 0 0) 0x7feda4003520 con 0x7fedbc155040 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 >> v2:172.21.15.174:3300/0 conn(0x7fedbc0b3540 msgr2=0x7fedbc0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 --2- 172.21.15.103:0/773186213 >> v2:172.21.15.174:3300/0 conn(0x7fedbc0b3540 0x7fedbc0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 >> v1:172.21.15.174:6789/0 conn(0x7fedbc0c5950 legacy=0x7fedbc0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc15afb0 con 0x7fedbc155040 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fedac001670 con 0x7fedbc155040 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 >> v1:172.21.15.103:6789/0 conn(0x7fedbc155040 legacy=0x7fedbc15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7feda4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feda4004800 0x7feda4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feda40051c0 0x7feda400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc0cbbf0 con 0x7feda40039b0 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feda400c070 con 0x7feda4004800 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7feda400c270 con 0x7feda40051c0 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedbaffd640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7feda4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedba7fc640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feda4004800 0x7feda4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedbb7fe640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feda40051c0 0x7feda400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedbaffd640 1 -- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feda40051c0 msgr2=0x7feda400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.949+0000 7fedbaffd640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feda40051c0 0x7feda400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedbaffd640 1 -- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feda4004800 msgr2=0x7feda4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedbaffd640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feda4004800 0x7feda4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedbaffd640 1 -- 172.21.15.103:0/773186213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda4003520 con 0x7feda40039b0 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedbb7fe640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feda40051c0 0x7feda400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedbb7fe640 1 -- 172.21.15.103:0/773186213 reap_dead start 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedbaffd640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7feda4003dd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c240 tx=0x7feda4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3255d61df961f59a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac007d10 con 0x7feda40039b0 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedac005ad0 con 0x7feda40039b0 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.950+0000 7fedb9ffb640 1 -- 172.21.15.103:0/773186213 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac007070 con 0x7feda40039b0 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.951+0000 7fedc1417640 1 -- 172.21.15.103:0/773186213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 msgr2=0x7feda4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.951+0000 7fedc1417640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7feda4003dd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c240 tx=0x7feda4005830 comp rx=0 tx=0).stop 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.951+0000 7fedc1417640 1 -- 172.21.15.103:0/773186213 shutdown_connections 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.951+0000 7fedc1417640 1 --2- 172.21.15.103:0/773186213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7feda4003dd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.951+0000 7fedc1417640 1 -- 172.21.15.103:0/773186213 >> 172.21.15.103:0/773186213 conn(0x7fedbc073340 msgr2=0x7fedbc073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.951+0000 7fedc1417640 1 -- 172.21.15.103:0/773186213 shutdown_connections 2024-09-19T05:38:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.951+0000 7fedc1417640 1 -- 172.21.15.103:0/773186213 wait complete. 2024-09-19T05:38:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.952+0000 7fedc1417640 1 Processor -- start 2024-09-19T05:38:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.952+0000 7fedc1417640 1 -- start start 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedc1417640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7fedbc14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedc1417640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedbc0c7d30 0x7fedbc14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedc1417640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedbc15ee30 0x7fedbc0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedc1417640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc15b850 con 0x7feda40039b0 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedc1417640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc15b570 con 0x7fedbc0c7d30 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedc1417640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc0cb540 con 0x7fedbc15ee30 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7fedbc14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7fedbc14e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46152/0 (socket says 172.21.15.103:46152) 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 -- 172.21.15.103:0/3892520226 learned_addr learned my addr 172.21.15.103:0/3892520226 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbb7fe640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedbc15ee30 0x7fedbc0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedba7fc640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedbc0c7d30 0x7fedbc14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 -- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedbc15ee30 msgr2=0x7fedbc0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedbc15ee30 0x7fedbc0cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 -- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedbc0c7d30 msgr2=0x7fedbc14dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedbc0c7d30 0x7fedbc14dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 -- 172.21.15.103:0/3892520226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc0ca760 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.953+0000 7fedbaffd640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7fedbc14e940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c240 tx=0x7fedbc15b180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.954+0000 7feda37fe640 1 -- 172.21.15.103:0/3892520226 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac041070 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.954+0000 7feda37fe640 1 -- 172.21.15.103:0/3892520226 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedac004e20 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.954+0000 7feda37fe640 1 -- 172.21.15.103:0/3892520226 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac007d10 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.954+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc0ca1a0 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.954+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc14d0c0 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.955+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedbc0d1730 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.955+0000 7feda37fe640 1 -- 172.21.15.103:0/3892520226 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fedac044070 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.956+0000 7feda37fe640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feda806c2b0 0x7feda806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.956+0000 7fedba7fc640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feda806c2b0 0x7feda806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.956+0000 7feda37fe640 1 -- 172.21.15.103:0/3892520226 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fedac0abe60 con 0x7feda40039b0 2024-09-19T05:38:08.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.956+0000 7fedba7fc640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feda806c2b0 0x7feda806e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0d0320 tx=0x7fedb0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:08.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:08.960+0000 7feda37fe640 1 -- 172.21.15.103:0/3892520226 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fedbc0d1730 con 0x7feda40039b0 2024-09-19T05:38:09.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.125+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedbc14e0e0 con 0x7feda806c2b0 2024-09-19T05:38:09.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.132+0000 7feda37fe640 1 -- 172.21.15.103:0/3892520226 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7fedb0014b50 con 0x7feda806c2b0 2024-09-19T05:38:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:09.140 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:38:09.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feda806c2b0 msgr2=0x7feda806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feda806c2b0 0x7feda806e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0d0320 tx=0x7fedb0009190 comp rx=0 tx=0).stop 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 msgr2=0x7fedbc14e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7fedbc14e940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c240 tx=0x7fedbc15b180 comp rx=0 tx=0).stop 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 shutdown_connections 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feda806c2b0 0x7feda806e770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedbc15ee30 0x7fedbc0cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedbc0c7d30 0x7fedbc14dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 --2- 172.21.15.103:0/3892520226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feda40039b0 0x7fedbc14e940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 >> 172.21.15.103:0/3892520226 conn(0x7fedbc073340 msgr2=0x7fedbc152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 shutdown_connections 2024-09-19T05:38:09.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.136+0000 7fedc1417640 1 -- 172.21.15.103:0/3892520226 wait complete. 2024-09-19T05:38:09.148 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-19T05:38:08.181854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218576,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756144,"statfs":{"total":773094113280,"available":772870291456,"internally_reserved":0,"allocated":2392064,"data_stored":2082308,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526146+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:37:50.526146+0000","last_peered":"2024-09-19T05:37:50.526146+0000","last_clean":"2024-09-19T05:37:50.526146+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:37:50.526146+0000","last_undegraded":"2024-09-19T05:37:50.526146+0000","last_fullsized":"2024-09-19T05:37:50.526146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830894+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:37:49.830894+0000","last_peered":"2024-09-19T05:37:49.830894+0000","last_clean":"2024-09-19T05:37:49.830894+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:37:49.830894+0000","last_undegraded":"2024-09-19T05:37:49.830894+0000","last_fullsized":"2024-09-19T05:37:49.830894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830981+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:37:49.830981+0000","last_peered":"2024-09-19T05:37:49.830981+0000","last_clean":"2024-09-19T05:37:49.830981+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:37:49.830981+0000","last_undegraded":"2024-09-19T05:37:49.830981+0000","last_fullsized":"2024-09-19T05:37:49.830981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525978+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:37:50.525978+0000","last_peered":"2024-09-19T05:37:50.525978+0000","last_clean":"2024-09-19T05:37:50.525978+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:37:50.525978+0000","last_undegraded":"2024-09-19T05:37:50.525978+0000","last_fullsized":"2024-09-19T05:37:50.525978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525568+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:37:50.525568+0000","last_peered":"2024-09-19T05:37:50.525568+0000","last_clean":"2024-09-19T05:37:50.525568+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:37:50.525568+0000","last_undegraded":"2024-09-19T05:37:50.525568+0000","last_fullsized":"2024-09-19T05:37:50.525568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526316+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:37:50.526316+0000","last_peered":"2024-09-19T05:37:50.526316+0000","last_clean":"2024-09-19T05:37:50.526316+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:37:50.526316+0000","last_undegraded":"2024-09-19T05:37:50.526316+0000","last_fullsized":"2024-09-19T05:37:50.526316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836803+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:37:49.836803+0000","last_peered":"2024-09-19T05:37:49.836803+0000","last_clean":"2024-09-19T05:37:49.836803+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:37:49.836803+0000","last_undegraded":"2024-09-19T05:37:49.836803+0000","last_fullsized":"2024-09-19T05:37:49.836803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525961+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:37:50.525961+0000","last_peered":"2024-09-19T05:37:50.525961+0000","last_clean":"2024-09-19T05:37:50.525961+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:37:50.525961+0000","last_undegraded":"2024-09-19T05:37:50.525961+0000","last_fullsized":"2024-09-19T05:37:50.525961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526008+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:37:50.526008+0000","last_peered":"2024-09-19T05:37:50.526008+0000","last_clean":"2024-09-19T05:37:50.526008+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:37:50.526008+0000","last_undegraded":"2024-09-19T05:37:50.526008+0000","last_fullsized":"2024-09-19T05:37:50.526008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836489+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:37:49.836489+0000","last_peered":"2024-09-19T05:37:49.836489+0000","last_clean":"2024-09-19T05:37:49.836489+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:37:49.836489+0000","last_undegraded":"2024-09-19T05:37:49.836489+0000","last_fullsized":"2024-09-19T05:37:49.836489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526194+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:37:50.526194+0000","last_peered":"2024-09-19T05:37:50.526194+0000","last_clean":"2024-09-19T05:37:50.526194+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:37:50.526194+0000","last_undegraded":"2024-09-19T05:37:50.526194+0000","last_fullsized":"2024-09-19T05:37:50.526194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836393+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:37:49.836393+0000","last_peered":"2024-09-19T05:37:49.836393+0000","last_clean":"2024-09-19T05:37:49.836393+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:37:49.836393+0000","last_undegraded":"2024-09-19T05:37:49.836393+0000","last_fullsized":"2024-09-19T05:37:49.836393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525923+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:37:50.525923+0000","last_peered":"2024-09-19T05:37:50.525923+0000","last_clean":"2024-09-19T05:37:50.525923+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:37:50.525923+0000","last_undegraded":"2024-09-19T05:37:50.525923+0000","last_fullsized":"2024-09-19T05:37:50.525923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527273+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:37:50.527273+0000","last_peered":"2024-09-19T05:37:50.527273+0000","last_clean":"2024-09-19T05:37:50.527273+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:37:50.527273+0000","last_undegraded":"2024-09-19T05:37:50.527273+0000","last_fullsized":"2024-09-19T05:37:50.527273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830473+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:37:49.830473+0000","last_peered":"2024-09-19T05:37:49.830473+0000","last_clean":"2024-09-19T05:37:49.830473+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:37:49.830473+0000","last_undegraded":"2024-09-19T05:37:49.830473+0000","last_fullsized":"2024-09-19T05:37:49.830473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526715+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:37:50.526715+0000","last_peered":"2024-09-19T05:37:50.526715+0000","last_clean":"2024-09-19T05:37:50.526715+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:37:50.526715+0000","last_undegraded":"2024-09-19T05:37:50.526715+0000","last_fullsized":"2024-09-19T05:37:50.526715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526929+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:37:50.526929+0000","last_peered":"2024-09-19T05:37:50.526929+0000","last_clean":"2024-09-19T05:37:50.526929+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:37:50.526929+0000","last_undegraded":"2024-09-19T05:37:50.526929+0000","last_fullsized":"2024-09-19T05:37:50.526929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830185+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:37:49.830185+0000","last_peered":"2024-09-19T05:37:49.830185+0000","last_clean":"2024-09-19T05:37:49.830185+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:37:49.830185+0000","last_undegraded":"2024-09-19T05:37:49.830185+0000","last_fullsized":"2024-09-19T05:37:49.830185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525802+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:37:50.525802+0000","last_peered":"2024-09-19T05:37:50.525802+0000","last_clean":"2024-09-19T05:37:50.525802+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:37:50.525802+0000","last_undegraded":"2024-09-19T05:37:50.525802+0000","last_fullsized":"2024-09-19T05:37:50.525802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526964+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:37:50.526964+0000","last_peered":"2024-09-19T05:37:50.526964+0000","last_clean":"2024-09-19T05:37:50.526964+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:37:50.526964+0000","last_undegraded":"2024-09-19T05:37:50.526964+0000","last_fullsized":"2024-09-19T05:37:50.526964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526748+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:37:50.526748+0000","last_peered":"2024-09-19T05:37:50.526748+0000","last_clean":"2024-09-19T05:37:50.526748+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:37:50.526748+0000","last_undegraded":"2024-09-19T05:37:50.526748+0000","last_fullsized":"2024-09-19T05:37:50.526748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525505+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:37:50.525505+0000","last_peered":"2024-09-19T05:37:50.525505+0000","last_clean":"2024-09-19T05:37:50.525505+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:37:50.525505+0000","last_undegraded":"2024-09-19T05:37:50.525505+0000","last_fullsized":"2024-09-19T05:37:50.525505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526205+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:37:50.526205+0000","last_peered":"2024-09-19T05:37:50.526205+0000","last_clean":"2024-09-19T05:37:50.526205+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:37:50.526205+0000","last_undegraded":"2024-09-19T05:37:50.526205+0000","last_fullsized":"2024-09-19T05:37:50.526205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526013+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:37:50.526013+0000","last_peered":"2024-09-19T05:37:50.526013+0000","last_clean":"2024-09-19T05:37:50.526013+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:37:50.526013+0000","last_undegraded":"2024-09-19T05:37:50.526013+0000","last_fullsized":"2024-09-19T05:37:50.526013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.837005+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:37:49.837005+0000","last_peered":"2024-09-19T05:37:49.837005+0000","last_clean":"2024-09-19T05:37:49.837005+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:37:49.837005+0000","last_undegraded":"2024-09-19T05:37:49.837005+0000","last_fullsized":"2024-09-19T05:37:49.837005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526592+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:37:50.526592+0000","last_peered":"2024-09-19T05:37:50.526592+0000","last_clean":"2024-09-19T05:37:50.526592+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:37:50.526592+0000","last_undegraded":"2024-09-19T05:37:50.526592+0000","last_fullsized":"2024-09-19T05:37:50.526592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830955+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:37:49.830955+0000","last_peered":"2024-09-19T05:37:49.830955+0000","last_clean":"2024-09-19T05:37:49.830955+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:37:49.830955+0000","last_undegraded":"2024-09-19T05:37:49.830955+0000","last_fullsized":"2024-09-19T05:37:49.830955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526862+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:37:50.526862+0000","last_peered":"2024-09-19T05:37:50.526862+0000","last_clean":"2024-09-19T05:37:50.526862+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:37:50.526862+0000","last_undegraded":"2024-09-19T05:37:50.526862+0000","last_fullsized":"2024-09-19T05:37:50.526862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829936+0000","last_change":"2024-09-19T05:37:48.360604+0000","last_active":"2024-09-19T05:37:49.829936+0000","last_peered":"2024-09-19T05:37:49.829936+0000","last_clean":"2024-09-19T05:37:49.829936+0000","last_became_active":"2024-09-19T05:37:48.360142+0000","last_became_peered":"2024-09-19T05:37:48.360142+0000","last_unstale":"2024-09-19T05:37:49.829936+0000","last_undegraded":"2024-09-19T05:37:49.829936+0000","last_fullsized":"2024-09-19T05:37:49.829936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:52.762613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526855+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:37:50.526855+0000","last_peered":"2024-09-19T05:37:50.526855+0000","last_clean":"2024-09-19T05:37:50.526855+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:37:50.526855+0000","last_undegraded":"2024-09-19T05:37:50.526855+0000","last_fullsized":"2024-09-19T05:37:50.526855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526512+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:37:50.526512+0000","last_peered":"2024-09-19T05:37:50.526512+0000","last_clean":"2024-09-19T05:37:50.526512+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:37:50.526512+0000","last_undegraded":"2024-09-19T05:37:50.526512+0000","last_fullsized":"2024-09-19T05:37:50.526512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526178+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:37:50.526178+0000","last_peered":"2024-09-19T05:37:50.526178+0000","last_clean":"2024-09-19T05:37:50.526178+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:37:50.526178+0000","last_undegraded":"2024-09-19T05:37:50.526178+0000","last_fullsized":"2024-09-19T05:37:50.526178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836580+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:37:49.836580+0000","last_peered":"2024-09-19T05:37:49.836580+0000","last_clean":"2024-09-19T05:37:49.836580+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:37:49.836580+0000","last_undegraded":"2024-09-19T05:37:49.836580+0000","last_fullsized":"2024-09-19T05:37:49.836580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526879+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:37:50.526879+0000","last_peered":"2024-09-19T05:37:50.526879+0000","last_clean":"2024-09-19T05:37:50.526879+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:37:50.526879+0000","last_undegraded":"2024-09-19T05:37:50.526879+0000","last_fullsized":"2024-09-19T05:37:50.526879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526516+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:37:50.526516+0000","last_peered":"2024-09-19T05:37:50.526516+0000","last_clean":"2024-09-19T05:37:50.526516+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:37:50.526516+0000","last_undegraded":"2024-09-19T05:37:50.526516+0000","last_fullsized":"2024-09-19T05:37:50.526516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526515+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:37:50.526515+0000","last_peered":"2024-09-19T05:37:50.526515+0000","last_clean":"2024-09-19T05:37:50.526515+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:37:50.526515+0000","last_undegraded":"2024-09-19T05:37:50.526515+0000","last_fullsized":"2024-09-19T05:37:50.526515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836809+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:37:49.836809+0000","last_peered":"2024-09-19T05:37:49.836809+0000","last_clean":"2024-09-19T05:37:49.836809+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:37:49.836809+0000","last_undegraded":"2024-09-19T05:37:49.836809+0000","last_fullsized":"2024-09-19T05:37:49.836809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526796+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:37:50.526796+0000","last_peered":"2024-09-19T05:37:50.526796+0000","last_clean":"2024-09-19T05:37:50.526796+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:37:50.526796+0000","last_undegraded":"2024-09-19T05:37:50.526796+0000","last_fullsized":"2024-09-19T05:37:50.526796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525410+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:37:50.525410+0000","last_peered":"2024-09-19T05:37:50.525410+0000","last_clean":"2024-09-19T05:37:50.525410+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:37:50.525410+0000","last_undegraded":"2024-09-19T05:37:50.525410+0000","last_fullsized":"2024-09-19T05:37:50.525410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525365+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:37:50.525365+0000","last_peered":"2024-09-19T05:37:50.525365+0000","last_clean":"2024-09-19T05:37:50.525365+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:37:50.525365+0000","last_undegraded":"2024-09-19T05:37:50.525365+0000","last_fullsized":"2024-09-19T05:37:50.525365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526961+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:37:50.526961+0000","last_peered":"2024-09-19T05:37:50.526961+0000","last_clean":"2024-09-19T05:37:50.526961+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:37:50.526961+0000","last_undegraded":"2024-09-19T05:37:50.526961+0000","last_fullsized":"2024-09-19T05:37:50.526961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525663+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:37:50.525663+0000","last_peered":"2024-09-19T05:37:50.525663+0000","last_clean":"2024-09-19T05:37:50.525663+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:37:50.525663+0000","last_undegraded":"2024-09-19T05:37:50.525663+0000","last_fullsized":"2024-09-19T05:37:50.525663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525493+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:37:50.525493+0000","last_peered":"2024-09-19T05:37:50.525493+0000","last_clean":"2024-09-19T05:37:50.525493+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:37:50.525493+0000","last_undegraded":"2024-09-19T05:37:50.525493+0000","last_fullsized":"2024-09-19T05:37:50.525493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525931+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:37:50.525931+0000","last_peered":"2024-09-19T05:37:50.525931+0000","last_clean":"2024-09-19T05:37:50.525931+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:37:50.525931+0000","last_undegraded":"2024-09-19T05:37:50.525931+0000","last_fullsized":"2024-09-19T05:37:50.525931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830243+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:37:49.830243+0000","last_peered":"2024-09-19T05:37:49.830243+0000","last_clean":"2024-09-19T05:37:49.830243+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:37:49.830243+0000","last_undegraded":"2024-09-19T05:37:49.830243+0000","last_fullsized":"2024-09-19T05:37:49.830243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836107+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:37:49.836107+0000","last_peered":"2024-09-19T05:37:49.836107+0000","last_clean":"2024-09-19T05:37:49.836107+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:37:49.836107+0000","last_undegraded":"2024-09-19T05:37:49.836107+0000","last_fullsized":"2024-09-19T05:37:49.836107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525629+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:37:50.525629+0000","last_peered":"2024-09-19T05:37:50.525629+0000","last_clean":"2024-09-19T05:37:50.525629+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:37:50.525629+0000","last_undegraded":"2024-09-19T05:37:50.525629+0000","last_fullsized":"2024-09-19T05:37:50.525629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836135+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:37:49.836135+0000","last_peered":"2024-09-19T05:37:49.836135+0000","last_clean":"2024-09-19T05:37:49.836135+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:37:49.836135+0000","last_undegraded":"2024-09-19T05:37:49.836135+0000","last_fullsized":"2024-09-19T05:37:49.836135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526130+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:37:50.526130+0000","last_peered":"2024-09-19T05:37:50.526130+0000","last_clean":"2024-09-19T05:37:50.526130+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:37:50.526130+0000","last_undegraded":"2024-09-19T05:37:50.526130+0000","last_fullsized":"2024-09-19T05:37:50.526130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525763+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:37:50.525763+0000","last_peered":"2024-09-19T05:37:50.525763+0000","last_clean":"2024-09-19T05:37:50.525763+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:37:50.525763+0000","last_undegraded":"2024-09-19T05:37:50.525763+0000","last_fullsized":"2024-09-19T05:37:50.525763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836366+0000","last_change":"2024-09-19T05:37:48.360455+0000","last_active":"2024-09-19T05:37:49.836366+0000","last_peered":"2024-09-19T05:37:49.836366+0000","last_clean":"2024-09-19T05:37:49.836366+0000","last_became_active":"2024-09-19T05:37:48.360015+0000","last_became_peered":"2024-09-19T05:37:48.360015+0000","last_unstale":"2024-09-19T05:37:49.836366+0000","last_undegraded":"2024-09-19T05:37:49.836366+0000","last_fullsized":"2024-09-19T05:37:49.836366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:58.281260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836248+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:37:49.836248+0000","last_peered":"2024-09-19T05:37:49.836248+0000","last_clean":"2024-09-19T05:37:49.836248+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:37:49.836248+0000","last_undegraded":"2024-09-19T05:37:49.836248+0000","last_fullsized":"2024-09-19T05:37:49.836248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526377+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:37:50.526377+0000","last_peered":"2024-09-19T05:37:50.526377+0000","last_clean":"2024-09-19T05:37:50.526377+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:37:50.526377+0000","last_undegraded":"2024-09-19T05:37:50.526377+0000","last_fullsized":"2024-09-19T05:37:50.526377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526335+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:37:50.526335+0000","last_peered":"2024-09-19T05:37:50.526335+0000","last_clean":"2024-09-19T05:37:50.526335+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:37:50.526335+0000","last_undegraded":"2024-09-19T05:37:50.526335+0000","last_fullsized":"2024-09-19T05:37:50.526335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526501+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:37:50.526501+0000","last_peered":"2024-09-19T05:37:50.526501+0000","last_clean":"2024-09-19T05:37:50.526501+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:37:50.526501+0000","last_undegraded":"2024-09-19T05:37:50.526501+0000","last_fullsized":"2024-09-19T05:37:50.526501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525419+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:37:50.525419+0000","last_peered":"2024-09-19T05:37:50.525419+0000","last_clean":"2024-09-19T05:37:50.525419+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:37:50.525419+0000","last_undegraded":"2024-09-19T05:37:50.525419+0000","last_fullsized":"2024-09-19T05:37:50.525419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835474+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:37:49.835474+0000","last_peered":"2024-09-19T05:37:49.835474+0000","last_clean":"2024-09-19T05:37:49.835474+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:37:49.835474+0000","last_undegraded":"2024-09-19T05:37:49.835474+0000","last_fullsized":"2024-09-19T05:37:49.835474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526347+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:37:50.526347+0000","last_peered":"2024-09-19T05:37:50.526347+0000","last_clean":"2024-09-19T05:37:50.526347+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:37:50.526347+0000","last_undegraded":"2024-09-19T05:37:50.526347+0000","last_fullsized":"2024-09-19T05:37:50.526347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526647+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:37:50.526647+0000","last_peered":"2024-09-19T05:37:50.526647+0000","last_clean":"2024-09-19T05:37:50.526647+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:37:50.526647+0000","last_undegraded":"2024-09-19T05:37:50.526647+0000","last_fullsized":"2024-09-19T05:37:50.526647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525843+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:37:50.525843+0000","last_peered":"2024-09-19T05:37:50.525843+0000","last_clean":"2024-09-19T05:37:50.525843+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:37:50.525843+0000","last_undegraded":"2024-09-19T05:37:50.525843+0000","last_fullsized":"2024-09-19T05:37:50.525843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525805+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:37:50.525805+0000","last_peered":"2024-09-19T05:37:50.525805+0000","last_clean":"2024-09-19T05:37:50.525805+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:37:50.525805+0000","last_undegraded":"2024-09-19T05:37:50.525805+0000","last_fullsized":"2024-09-19T05:37:50.525805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525050+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:37:50.525050+0000","last_peered":"2024-09-19T05:37:50.525050+0000","last_clean":"2024-09-19T05:37:50.525050+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:37:50.525050+0000","last_undegraded":"2024-09-19T05:37:50.525050+0000","last_fullsized":"2024-09-19T05:37:50.525050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525789+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:37:50.525789+0000","last_peered":"2024-09-19T05:37:50.525789+0000","last_clean":"2024-09-19T05:37:50.525789+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:37:50.525789+0000","last_undegraded":"2024-09-19T05:37:50.525789+0000","last_fullsized":"2024-09-19T05:37:50.525789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836113+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:37:49.836113+0000","last_peered":"2024-09-19T05:37:49.836113+0000","last_clean":"2024-09-19T05:37:49.836113+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:37:49.836113+0000","last_undegraded":"2024-09-19T05:37:49.836113+0000","last_fullsized":"2024-09-19T05:37:49.836113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836182+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:37:49.836182+0000","last_peered":"2024-09-19T05:37:49.836182+0000","last_clean":"2024-09-19T05:37:49.836182+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:37:49.836182+0000","last_undegraded":"2024-09-19T05:37:49.836182+0000","last_fullsized":"2024-09-19T05:37:49.836182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830874+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:37:49.830874+0000","last_peered":"2024-09-19T05:37:49.830874+0000","last_clean":"2024-09-19T05:37:49.830874+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:37:49.830874+0000","last_undegraded":"2024-09-19T05:37:49.830874+0000","last_fullsized":"2024-09-19T05:37:49.830874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525857+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:37:50.525857+0000","last_peered":"2024-09-19T05:37:50.525857+0000","last_clean":"2024-09-19T05:37:50.525857+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:37:50.525857+0000","last_undegraded":"2024-09-19T05:37:50.525857+0000","last_fullsized":"2024-09-19T05:37:50.525857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836806+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:37:49.836806+0000","last_peered":"2024-09-19T05:37:49.836806+0000","last_clean":"2024-09-19T05:37:49.836806+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:37:49.836806+0000","last_undegraded":"2024-09-19T05:37:49.836806+0000","last_fullsized":"2024-09-19T05:37:49.836806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830313+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:37:49.830313+0000","last_peered":"2024-09-19T05:37:49.830313+0000","last_clean":"2024-09-19T05:37:49.830313+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:37:49.830313+0000","last_undegraded":"2024-09-19T05:37:49.830313+0000","last_fullsized":"2024-09-19T05:37:49.830313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525852+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:37:50.525852+0000","last_peered":"2024-09-19T05:37:50.525852+0000","last_clean":"2024-09-19T05:37:50.525852+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:37:50.525852+0000","last_undegraded":"2024-09-19T05:37:50.525852+0000","last_fullsized":"2024-09-19T05:37:50.525852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526451+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:37:50.526451+0000","last_peered":"2024-09-19T05:37:50.526451+0000","last_clean":"2024-09-19T05:37:50.526451+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:37:50.526451+0000","last_undegraded":"2024-09-19T05:37:50.526451+0000","last_fullsized":"2024-09-19T05:37:50.526451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836390+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:37:49.836390+0000","last_peered":"2024-09-19T05:37:49.836390+0000","last_clean":"2024-09-19T05:37:49.836390+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:37:49.836390+0000","last_undegraded":"2024-09-19T05:37:49.836390+0000","last_fullsized":"2024-09-19T05:37:49.836390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526036+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:37:50.526036+0000","last_peered":"2024-09-19T05:37:50.526036+0000","last_clean":"2024-09-19T05:37:50.526036+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:37:50.526036+0000","last_undegraded":"2024-09-19T05:37:50.526036+0000","last_fullsized":"2024-09-19T05:37:50.526036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:56.304759+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:37:56.304759+0000","last_peered":"2024-09-19T05:37:56.304759+0000","last_clean":"2024-09-19T05:37:56.304759+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:37:56.304759+0000","last_undegraded":"2024-09-19T05:37:56.304759+0000","last_fullsized":"2024-09-19T05:37:56.304759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526654+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:37:50.526654+0000","last_peered":"2024-09-19T05:37:50.526654+0000","last_clean":"2024-09-19T05:37:50.526654+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:37:50.526654+0000","last_undegraded":"2024-09-19T05:37:50.526654+0000","last_fullsized":"2024-09-19T05:37:50.526654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527026+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:37:50.527026+0000","last_peered":"2024-09-19T05:37:50.527026+0000","last_clean":"2024-09-19T05:37:50.527026+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:37:50.527026+0000","last_undegraded":"2024-09-19T05:37:50.527026+0000","last_fullsized":"2024-09-19T05:37:50.527026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526407+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:37:50.526407+0000","last_peered":"2024-09-19T05:37:50.526407+0000","last_clean":"2024-09-19T05:37:50.526407+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:37:50.526407+0000","last_undegraded":"2024-09-19T05:37:50.526407+0000","last_fullsized":"2024-09-19T05:37:50.526407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526199+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:37:50.526199+0000","last_peered":"2024-09-19T05:37:50.526199+0000","last_clean":"2024-09-19T05:37:50.526199+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:37:50.526199+0000","last_undegraded":"2024-09-19T05:37:50.526199+0000","last_fullsized":"2024-09-19T05:37:50.526199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526059+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:37:50.526059+0000","last_peered":"2024-09-19T05:37:50.526059+0000","last_clean":"2024-09-19T05:37:50.526059+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:37:50.526059+0000","last_undegraded":"2024-09-19T05:37:50.526059+0000","last_fullsized":"2024-09-19T05:37:50.526059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836248+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:37:49.836248+0000","last_peered":"2024-09-19T05:37:49.836248+0000","last_clean":"2024-09-19T05:37:49.836248+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:37:49.836248+0000","last_undegraded":"2024-09-19T05:37:49.836248+0000","last_fullsized":"2024-09-19T05:37:49.836248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830099+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:37:49.830099+0000","last_peered":"2024-09-19T05:37:49.830099+0000","last_clean":"2024-09-19T05:37:49.830099+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:37:49.830099+0000","last_undegraded":"2024-09-19T05:37:49.830099+0000","last_fullsized":"2024-09-19T05:37:49.830099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836270+0000","last_change":"2024-09-19T05:37:43.798426+0000","last_active":"2024-09-19T05:37:49.836270+0000","last_peered":"2024-09-19T05:37:49.836270+0000","last_clean":"2024-09-19T05:37:49.836270+0000","last_became_active":"2024-09-19T05:37:43.797575+0000","last_became_peered":"2024-09-19T05:37:43.797575+0000","last_unstale":"2024-09-19T05:37:49.836270+0000","last_undegraded":"2024-09-19T05:37:49.836270+0000","last_fullsized":"2024-09-19T05:37:49.836270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:07.139397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836919+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:37:49.836919+0000","last_peered":"2024-09-19T05:37:49.836919+0000","last_clean":"2024-09-19T05:37:49.836919+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:37:49.836919+0000","last_undegraded":"2024-09-19T05:37:49.836919+0000","last_fullsized":"2024-09-19T05:37:49.836919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830059+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:37:49.830059+0000","last_peered":"2024-09-19T05:37:49.830059+0000","last_clean":"2024-09-19T05:37:49.830059+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:37:49.830059+0000","last_undegraded":"2024-09-19T05:37:49.830059+0000","last_fullsized":"2024-09-19T05:37:49.830059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525638+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:37:50.525638+0000","last_peered":"2024-09-19T05:37:50.525638+0000","last_clean":"2024-09-19T05:37:50.525638+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:37:50.525638+0000","last_undegraded":"2024-09-19T05:37:50.525638+0000","last_fullsized":"2024-09-19T05:37:50.525638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525626+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:37:50.525626+0000","last_peered":"2024-09-19T05:37:50.525626+0000","last_clean":"2024-09-19T05:37:50.525626+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:37:50.525626+0000","last_undegraded":"2024-09-19T05:37:50.525626+0000","last_fullsized":"2024-09-19T05:37:50.525626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835612+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:37:49.835612+0000","last_peered":"2024-09-19T05:37:49.835612+0000","last_clean":"2024-09-19T05:37:49.835612+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:37:49.835612+0000","last_undegraded":"2024-09-19T05:37:49.835612+0000","last_fullsized":"2024-09-19T05:37:49.835612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836846+0000","last_change":"2024-09-19T05:37:47.808596+0000","last_active":"2024-09-19T05:37:49.836846+0000","last_peered":"2024-09-19T05:37:49.836846+0000","last_clean":"2024-09-19T05:37:49.836846+0000","last_became_active":"2024-09-19T05:37:47.808169+0000","last_became_peered":"2024-09-19T05:37:47.808169+0000","last_unstale":"2024-09-19T05:37:49.836846+0000","last_undegraded":"2024-09-19T05:37:49.836846+0000","last_fullsized":"2024-09-19T05:37:49.836846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:44.137286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830088+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:37:49.830088+0000","last_peered":"2024-09-19T05:37:49.830088+0000","last_clean":"2024-09-19T05:37:49.830088+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:37:49.830088+0000","last_undegraded":"2024-09-19T05:37:49.830088+0000","last_fullsized":"2024-09-19T05:37:49.830088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830275+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:37:49.830275+0000","last_peered":"2024-09-19T05:37:49.830275+0000","last_clean":"2024-09-19T05:37:49.830275+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:37:49.830275+0000","last_undegraded":"2024-09-19T05:37:49.830275+0000","last_fullsized":"2024-09-19T05:37:49.830275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836491+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:37:49.836491+0000","last_peered":"2024-09-19T05:37:49.836491+0000","last_clean":"2024-09-19T05:37:49.836491+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:37:49.836491+0000","last_undegraded":"2024-09-19T05:37:49.836491+0000","last_fullsized":"2024-09-19T05:37:49.836491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526741+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:37:50.526741+0000","last_peered":"2024-09-19T05:37:50.526741+0000","last_clean":"2024-09-19T05:37:50.526741+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:37:50.526741+0000","last_undegraded":"2024-09-19T05:37:50.526741+0000","last_fullsized":"2024-09-19T05:37:50.526741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525558+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:37:50.525558+0000","last_peered":"2024-09-19T05:37:50.525558+0000","last_clean":"2024-09-19T05:37:50.525558+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:37:50.525558+0000","last_undegraded":"2024-09-19T05:37:50.525558+0000","last_fullsized":"2024-09-19T05:37:50.525558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830617+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:37:49.830617+0000","last_peered":"2024-09-19T05:37:49.830617+0000","last_clean":"2024-09-19T05:37:49.830617+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:37:49.830617+0000","last_undegraded":"2024-09-19T05:37:49.830617+0000","last_fullsized":"2024-09-19T05:37:49.830617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526434+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:37:50.526434+0000","last_peered":"2024-09-19T05:37:50.526434+0000","last_clean":"2024-09-19T05:37:50.526434+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:37:50.526434+0000","last_undegraded":"2024-09-19T05:37:50.526434+0000","last_fullsized":"2024-09-19T05:37:50.526434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830768+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:37:49.830768+0000","last_peered":"2024-09-19T05:37:49.830768+0000","last_clean":"2024-09-19T05:37:49.830768+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:37:49.830768+0000","last_undegraded":"2024-09-19T05:37:49.830768+0000","last_fullsized":"2024-09-19T05:37:49.830768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835869+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:37:49.835869+0000","last_peered":"2024-09-19T05:37:49.835869+0000","last_clean":"2024-09-19T05:37:49.835869+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:37:49.835869+0000","last_undegraded":"2024-09-19T05:37:49.835869+0000","last_fullsized":"2024-09-19T05:37:49.835869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525234+0000","last_change":"2024-09-19T05:37:43.791626+0000","last_active":"2024-09-19T05:37:50.525234+0000","last_peered":"2024-09-19T05:37:50.525234+0000","last_clean":"2024-09-19T05:37:50.525234+0000","last_became_active":"2024-09-19T05:37:43.791176+0000","last_became_peered":"2024-09-19T05:37:43.791176+0000","last_unstale":"2024-09-19T05:37:50.525234+0000","last_undegraded":"2024-09-19T05:37:50.525234+0000","last_fullsized":"2024-09-19T05:37:50.525234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:30.947341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836714+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:37:49.836714+0000","last_peered":"2024-09-19T05:37:49.836714+0000","last_clean":"2024-09-19T05:37:49.836714+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:37:49.836714+0000","last_undegraded":"2024-09-19T05:37:49.836714+0000","last_fullsized":"2024-09-19T05:37:49.836714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526338+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:37:50.526338+0000","last_peered":"2024-09-19T05:37:50.526338+0000","last_clean":"2024-09-19T05:37:50.526338+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:37:50.526338+0000","last_undegraded":"2024-09-19T05:37:50.526338+0000","last_fullsized":"2024-09-19T05:37:50.526338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830471+0000","last_change":"2024-09-19T05:37:43.795638+0000","last_active":"2024-09-19T05:37:49.830471+0000","last_peered":"2024-09-19T05:37:49.830471+0000","last_clean":"2024-09-19T05:37:49.830471+0000","last_became_active":"2024-09-19T05:37:43.795360+0000","last_became_peered":"2024-09-19T05:37:43.795360+0000","last_unstale":"2024-09-19T05:37:49.830471+0000","last_undegraded":"2024-09-19T05:37:49.830471+0000","last_fullsized":"2024-09-19T05:37:49.830471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:08.525535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526265+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:37:50.526265+0000","last_peered":"2024-09-19T05:37:50.526265+0000","last_clean":"2024-09-19T05:37:50.526265+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:37:50.526265+0000","last_undegraded":"2024-09-19T05:37:50.526265+0000","last_fullsized":"2024-09-19T05:37:50.526265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836748+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:37:49.836748+0000","last_peered":"2024-09-19T05:37:49.836748+0000","last_clean":"2024-09-19T05:37:49.836748+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:37:49.836748+0000","last_undegraded":"2024-09-19T05:37:49.836748+0000","last_fullsized":"2024-09-19T05:37:49.836748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830871+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:37:49.830871+0000","last_peered":"2024-09-19T05:37:49.830871+0000","last_clean":"2024-09-19T05:37:49.830871+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:37:49.830871+0000","last_undegraded":"2024-09-19T05:37:49.830871+0000","last_fullsized":"2024-09-19T05:37:49.830871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835569+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:37:49.835569+0000","last_peered":"2024-09-19T05:37:49.835569+0000","last_clean":"2024-09-19T05:37:49.835569+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:37:49.835569+0000","last_undegraded":"2024-09-19T05:37:49.835569+0000","last_fullsized":"2024-09-19T05:37:49.835569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830198+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:37:49.830198+0000","last_peered":"2024-09-19T05:37:49.830198+0000","last_clean":"2024-09-19T05:37:49.830198+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:37:49.830198+0000","last_undegraded":"2024-09-19T05:37:49.830198+0000","last_fullsized":"2024-09-19T05:37:49.830198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836658+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:37:49.836658+0000","last_peered":"2024-09-19T05:37:49.836658+0000","last_clean":"2024-09-19T05:37:49.836658+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:37:49.836658+0000","last_undegraded":"2024-09-19T05:37:49.836658+0000","last_fullsized":"2024-09-19T05:37:49.836658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526251+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:37:50.526251+0000","last_peered":"2024-09-19T05:37:50.526251+0000","last_clean":"2024-09-19T05:37:50.526251+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:37:50.526251+0000","last_undegraded":"2024-09-19T05:37:50.526251+0000","last_fullsized":"2024-09-19T05:37:50.526251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836668+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:37:49.836668+0000","last_peered":"2024-09-19T05:37:49.836668+0000","last_clean":"2024-09-19T05:37:49.836668+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:37:49.836668+0000","last_undegraded":"2024-09-19T05:37:49.836668+0000","last_fullsized":"2024-09-19T05:37:49.836668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526418+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:37:50.526418+0000","last_peered":"2024-09-19T05:37:50.526418+0000","last_clean":"2024-09-19T05:37:50.526418+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:37:50.526418+0000","last_undegraded":"2024-09-19T05:37:50.526418+0000","last_fullsized":"2024-09-19T05:37:50.526418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525330+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:37:50.525330+0000","last_peered":"2024-09-19T05:37:50.525330+0000","last_clean":"2024-09-19T05:37:50.525330+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:37:50.525330+0000","last_undegraded":"2024-09-19T05:37:50.525330+0000","last_fullsized":"2024-09-19T05:37:50.525330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836515+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:37:49.836515+0000","last_peered":"2024-09-19T05:37:49.836515+0000","last_clean":"2024-09-19T05:37:49.836515+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:37:49.836515+0000","last_undegraded":"2024-09-19T05:37:49.836515+0000","last_fullsized":"2024-09-19T05:37:49.836515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835454+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:37:49.835454+0000","last_peered":"2024-09-19T05:37:49.835454+0000","last_clean":"2024-09-19T05:37:49.835454+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:37:49.835454+0000","last_undegraded":"2024-09-19T05:37:49.835454+0000","last_fullsized":"2024-09-19T05:37:49.835454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525715+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:37:50.525715+0000","last_peered":"2024-09-19T05:37:50.525715+0000","last_clean":"2024-09-19T05:37:50.525715+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:37:50.525715+0000","last_undegraded":"2024-09-19T05:37:50.525715+0000","last_fullsized":"2024-09-19T05:37:50.525715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525756+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:37:50.525756+0000","last_peered":"2024-09-19T05:37:50.525756+0000","last_clean":"2024-09-19T05:37:50.525756+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:37:50.525756+0000","last_undegraded":"2024-09-19T05:37:50.525756+0000","last_fullsized":"2024-09-19T05:37:50.525756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830450+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:37:49.830450+0000","last_peered":"2024-09-19T05:37:49.830450+0000","last_clean":"2024-09-19T05:37:49.830450+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:37:49.830450+0000","last_undegraded":"2024-09-19T05:37:49.830450+0000","last_fullsized":"2024-09-19T05:37:49.830450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526998+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:37:50.526998+0000","last_peered":"2024-09-19T05:37:50.526998+0000","last_clean":"2024-09-19T05:37:50.526998+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:37:50.526998+0000","last_undegraded":"2024-09-19T05:37:50.526998+0000","last_fullsized":"2024-09-19T05:37:50.526998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836290+0000","last_change":"2024-09-19T05:37:43.798142+0000","last_active":"2024-09-19T05:37:49.836290+0000","last_peered":"2024-09-19T05:37:49.836290+0000","last_clean":"2024-09-19T05:37:49.836290+0000","last_became_active":"2024-09-19T05:37:43.797843+0000","last_became_peered":"2024-09-19T05:37:43.797843+0000","last_unstale":"2024-09-19T05:37:49.836290+0000","last_undegraded":"2024-09-19T05:37:49.836290+0000","last_fullsized":"2024-09-19T05:37:49.836290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:02.764951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836653+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:37:49.836653+0000","last_peered":"2024-09-19T05:37:49.836653+0000","last_clean":"2024-09-19T05:37:49.836653+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:37:49.836653+0000","last_undegraded":"2024-09-19T05:37:49.836653+0000","last_fullsized":"2024-09-19T05:37:49.836653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526498+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:37:50.526498+0000","last_peered":"2024-09-19T05:37:50.526498+0000","last_clean":"2024-09-19T05:37:50.526498+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:37:50.526498+0000","last_undegraded":"2024-09-19T05:37:50.526498+0000","last_fullsized":"2024-09-19T05:37:50.526498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525773+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:37:50.525773+0000","last_peered":"2024-09-19T05:37:50.525773+0000","last_clean":"2024-09-19T05:37:50.525773+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:37:50.525773+0000","last_undegraded":"2024-09-19T05:37:50.525773+0000","last_fullsized":"2024-09-19T05:37:50.525773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836622+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:37:49.836622+0000","last_peered":"2024-09-19T05:37:49.836622+0000","last_clean":"2024-09-19T05:37:49.836622+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:37:49.836622+0000","last_undegraded":"2024-09-19T05:37:49.836622+0000","last_fullsized":"2024-09-19T05:37:49.836622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525795+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:37:50.525795+0000","last_peered":"2024-09-19T05:37:50.525795+0000","last_clean":"2024-09-19T05:37:50.525795+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:37:50.525795+0000","last_undegraded":"2024-09-19T05:37:50.525795+0000","last_fullsized":"2024-09-19T05:37:50.525795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836111+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:37:49.836111+0000","last_peered":"2024-09-19T05:37:49.836111+0000","last_clean":"2024-09-19T05:37:49.836111+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:37:49.836111+0000","last_undegraded":"2024-09-19T05:37:49.836111+0000","last_fullsized":"2024-09-19T05:37:49.836111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525884+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:37:50.525884+0000","last_peered":"2024-09-19T05:37:50.525884+0000","last_clean":"2024-09-19T05:37:50.525884+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:37:50.525884+0000","last_undegraded":"2024-09-19T05:37:50.525884+0000","last_fullsized":"2024-09-19T05:37:50.525884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526777+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:37:50.526777+0000","last_peered":"2024-09-19T05:37:50.526777+0000","last_clean":"2024-09-19T05:37:50.526777+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:37:50.526777+0000","last_undegraded":"2024-09-19T05:37:50.526777+0000","last_fullsized":"2024-09-19T05:37:50.526777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526294+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:37:50.526294+0000","last_peered":"2024-09-19T05:37:50.526294+0000","last_clean":"2024-09-19T05:37:50.526294+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:37:50.526294+0000","last_undegraded":"2024-09-19T05:37:50.526294+0000","last_fullsized":"2024-09-19T05:37:50.526294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":702486,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":115380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":278528,"data_stored":111626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":115380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":111536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":702542,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:09.153 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:38:09.153 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T05:38:09.154 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T05:38:09.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T05:38:09.154 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T05:38:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.285+0000 7f5698b3b640 1 Processor -- start 2024-09-19T05:38:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.285+0000 7f5698b3b640 1 -- start start 2024-09-19T05:38:09.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f5698b3b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 0x7f56940c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f5698b3b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f569415bc80 con 0x7f56940c3a50 2024-09-19T05:38:09.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f5698b3b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5694157c70 con 0x7f5694151ea0 2024-09-19T05:38:09.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f5698b3b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f56941585a0 con 0x7f56940c46c0 2024-09-19T05:38:09.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f5692d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f56940c3a50 0x7f569406eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53370/0 (socket says 172.21.15.103:53370) 2024-09-19T05:38:09.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f5692d9d640 1 -- 172.21.15.103:0/3079527091 learned_addr learned my addr 172.21.15.103:0/3079527091 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:09.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f5691d9b640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 0x7f56940c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320284036 0 0) 0x7f569415bc80 con 0x7f56940c3a50 2024-09-19T05:38:09.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f567c003520 con 0x7f56940c3a50 2024-09-19T05:38:09.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1170256701 0 0) 0x7f567c003520 con 0x7f56940c3a50 2024-09-19T05:38:09.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 msgr2=0x7f56940c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 0x7f56940c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 >> v1:172.21.15.174:6789/0 conn(0x7f5694151ea0 legacy=0x7f5694158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5694157f50 con 0x7f56940c3a50 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f568c0019f0 con 0x7f56940c3a50 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.286+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 >> v1:172.21.15.103:6789/0 conn(0x7f56940c3a50 legacy=0x7f569406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f569159a640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 0x7f567c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f569159a640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c003f20 0x7f567c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f569159a640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f567c004d40 0x7f567c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56941585a0 con 0x7f567c004d40 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f567c00ba20 con 0x7f567c003f20 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f567c00bc20 con 0x7f56940c46c0 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f5692d9d640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f567c004d40 0x7f567c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f5691d9b640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c003f20 0x7f567c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f569259c640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 0x7f567c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f5692d9d640 1 -- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 msgr2=0x7f567c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f5692d9d640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56940c46c0 0x7f567c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f5692d9d640 1 -- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c003f20 msgr2=0x7f567c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f5692d9d640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c003f20 0x7f567c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.287+0000 7f5692d9d640 1 -- 172.21.15.103:0/3079527091 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c003520 con 0x7f567c004d40 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5692d9d640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f567c004d40 0x7f567c0051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f568c00a810 tx=0x7f567c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9535e735b6e7dc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c00a430 con 0x7f567c004d40 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568c02f070 con 0x7f567c004d40 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f569159a640 1 -- 172.21.15.103:0/3079527091 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c02bc90 con 0x7f567c004d40 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5698b3b640 1 -- 172.21.15.103:0/3079527091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f567c004d40 msgr2=0x7f567c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5698b3b640 1 --2- 172.21.15.103:0/3079527091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f567c004d40 0x7f567c0051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f568c00a810 tx=0x7f567c005830 comp rx=0 tx=0).stop 2024-09-19T05:38:09.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5692d9d640 1 -- 172.21.15.103:0/3079527091 reap_dead start 2024-09-19T05:38:09.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5698b3b640 1 -- 172.21.15.103:0/3079527091 shutdown_connections 2024-09-19T05:38:09.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5698b3b640 1 -- 172.21.15.103:0/3079527091 >> 172.21.15.103:0/3079527091 conn(0x7f56940c9230 msgr2=0x7f56940c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5698b3b640 1 -- 172.21.15.103:0/3079527091 shutdown_connections 2024-09-19T05:38:09.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.288+0000 7f5698b3b640 1 -- 172.21.15.103:0/3079527091 wait complete. 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 Processor -- start 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 -- start start 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c004d40 0x7f569414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56941e12c0 0x7f569414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56941e1700 0x7f569414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56941596e0 con 0x7f56941e12c0 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5694152280 con 0x7f567c004d40 2024-09-19T05:38:09.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5698b3b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5694158a30 con 0x7f56941e1700 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.290+0000 7f5691d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56941e12c0 0x7f569414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56941e12c0 0x7f569414c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46176/0 (socket says 172.21.15.103:46176) 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 -- 172.21.15.103:0/1104131201 learned_addr learned my addr 172.21.15.103:0/1104131201 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f569259c640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c004d40 0x7f569414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5692d9d640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56941e1700 0x7f569414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 -- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56941e1700 msgr2=0x7f569414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56941e1700 0x7f569414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 -- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c004d40 msgr2=0x7f569414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c004d40 0x7f569414d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 -- 172.21.15.103:0/1104131201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56941e23f0 con 0x7f56941e12c0 2024-09-19T05:38:09.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5692d9d640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56941e1700 0x7f569414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5691d9b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56941e12c0 0x7f569414c420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5688011a70 tx=0x7f5688011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5682ffd640 1 -- 172.21.15.103:0/1104131201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688010db0 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5682ffd640 1 -- 172.21.15.103:0/1104131201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5688004030 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56941e26d0 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5682ffd640 1 -- 172.21.15.103:0/1104131201 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688004400 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.291+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941e2c90 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.292+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569415bf20 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.293+0000 7f5682ffd640 1 -- 172.21.15.103:0/1104131201 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5688003610 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.293+0000 7f5682ffd640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f567406c2b0 0x7f567406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.293+0000 7f5682ffd640 1 -- 172.21.15.103:0/1104131201 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f568808ded0 con 0x7f56941e12c0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.293+0000 7f569259c640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f567406c2b0 0x7f567406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.293+0000 7f569259c640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f567406c2b0 0x7f567406e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5684001940 tx=0x7f5684009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.297+0000 7f5682ffd640 1 -- 172.21.15.103:0/1104131201 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f568805c390 con 0x7f56941e12c0 2024-09-19T05:38:09.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.506+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5694147dc0 con 0x7f56941e12c0 2024-09-19T05:38:09.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.509+0000 7f5682ffd640 1 -- 172.21.15.103:0/1104131201 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173511 (secure 0 0 0) 0x7f568805bc90 con 0x7f56941e12c0 2024-09-19T05:38:09.513 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f567406c2b0 msgr2=0x7f567406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f567406c2b0 0x7f567406e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5684001940 tx=0x7f5684009040 comp rx=0 tx=0).stop 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56941e12c0 msgr2=0x7f569414c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56941e12c0 0x7f569414c420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5688011a70 tx=0x7f5688011e70 comp rx=0 tx=0).stop 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 shutdown_connections 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f567406c2b0 0x7f567406e770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56941e1700 0x7f569414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56941e12c0 0x7f569414c420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 --2- 172.21.15.103:0/1104131201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f567c004d40 0x7f569414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 >> 172.21.15.103:0/1104131201 conn(0x7f56940c9230 msgr2=0x7f569415a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 shutdown_connections 2024-09-19T05:38:09.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.512+0000 7f5698b3b640 1 -- 172.21.15.103:0/1104131201 wait complete. 2024-09-19T05:38:09.525 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2804194317},{"type":"v1","addr":"172.21.15.103:6833","nonce":2804194317}]},"active_addr":"172.21.15.103:6833/2804194317","active_change":"2024-09-19T05:37:24.167594+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":692165666}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2106178393}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1418135059}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":4190475818}]}]} 2024-09-19T05:38:09.530 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T05:38:09.530 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T05:38:09.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:09.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.628+0000 7f0eaaf11640 1 Processor -- start 2024-09-19T05:38:09.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.628+0000 7f0eaaf11640 1 -- start start 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0eaaf11640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ea4154f40 0x7f0ea40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0eaaf11640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0ea40cb1c0 0x7f0ea415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0eaaf11640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea40cb830 con 0x7f0ea4155320 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0eaaf11640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea40cbb10 con 0x7f0ea4154f40 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0eaaf11640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea40cbdf0 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea8cad640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ea4154f40 0x7f0ea40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea8cad640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ea4154f40 0x7f0ea40c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46178/0 (socket says 172.21.15.103:46178) 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea8cad640 1 -- 172.21.15.103:0/1230472417 learned_addr learned my addr 172.21.15.103:0/1230472417 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea94ae640 1 --2- 172.21.15.103:0/1230472417 >> v2:172.21.15.174:3300/0 conn(0x7f0ea40cb1c0 0x7f0ea415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea8cad640 1 -- 172.21.15.103:0/1230472417 >> v2:172.21.15.174:3300/0 conn(0x7f0ea40cb1c0 msgr2=0x7f0ea415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea8cad640 1 --2- 172.21.15.103:0/1230472417 >> v2:172.21.15.174:3300/0 conn(0x7f0ea40cb1c0 0x7f0ea415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea8cad640 1 -- 172.21.15.103:0/1230472417 >> v1:172.21.15.174:6789/0 conn(0x7f0ea4155320 legacy=0x7f0ea40d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.629+0000 7f0ea8cad640 1 -- 172.21.15.103:0/1230472417 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea40c5a90 con 0x7f0ea4154f40 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.630+0000 7f0ea8cad640 1 --2- 172.21.15.103:0/1230472417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea4154f40 0x7f0ea40c75b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ea415bdb0 tx=0x7f0e9802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af96de5cf578857 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.630+0000 7f0ea37fe640 1 -- 172.21.15.103:0/1230472417 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98037070 con 0x7f0ea4154f40 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.630+0000 7f0ea37fe640 1 -- 172.21.15.103:0/1230472417 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e98032440 con 0x7f0ea4154f40 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.630+0000 7f0ea37fe640 1 -- 172.21.15.103:0/1230472417 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98032810 con 0x7f0ea4154f40 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.630+0000 7f0eaaf11640 1 -- 172.21.15.103:0/1230472417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea4154f40 msgr2=0x7f0ea40c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.630+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/1230472417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea4154f40 0x7f0ea40c75b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ea415bdb0 tx=0x7f0e9802a2c0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.631+0000 7f0eaaf11640 1 -- 172.21.15.103:0/1230472417 shutdown_connections 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.631+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/1230472417 >> v2:172.21.15.174:3300/0 conn(0x7f0ea40cb1c0 0x7f0ea415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.631+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/1230472417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea4154f40 0x7f0ea40c75b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.631+0000 7f0eaaf11640 1 -- 172.21.15.103:0/1230472417 >> 172.21.15.103:0/1230472417 conn(0x7f0ea406bc10 msgr2=0x7f0ea406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.631+0000 7f0eaaf11640 1 -- 172.21.15.103:0/1230472417 shutdown_connections 2024-09-19T05:38:09.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.631+0000 7f0eaaf11640 1 -- 172.21.15.103:0/1230472417 wait complete. 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.632+0000 7f0eaaf11640 1 Processor -- start 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.632+0000 7f0eaaf11640 1 -- start start 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0eaaf11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea40cb1c0 0x7f0ea414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0eaaf11640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ea4154f40 0x7f0ea41f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0eaaf11640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ea415d6a0 0x7f0ea41506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0eaaf11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea40d1420 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0eaaf11640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea40d12a0 con 0x7f0ea4154f40 2024-09-19T05:38:09.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0eaaf11640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea40c5fb0 con 0x7f0ea415d6a0 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea40cb1c0 0x7f0ea414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea40cb1c0 0x7f0ea414d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46186/0 (socket says 172.21.15.103:46186) 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 -- 172.21.15.103:0/3410581221 learned_addr learned my addr 172.21.15.103:0/3410581221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea94ae640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ea415d6a0 0x7f0ea41506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea3fff640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ea4154f40 0x7f0ea41f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 -- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ea415d6a0 msgr2=0x7f0ea41506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ea415d6a0 0x7f0ea41506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 -- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ea4154f40 msgr2=0x7f0ea41f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ea4154f40 0x7f0ea41f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 -- 172.21.15.103:0/3410581221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea415dc00 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea94ae640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ea415d6a0 0x7f0ea41506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:09.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea3fff640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ea4154f40 0x7f0ea41f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:09.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea8cad640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea40cb1c0 0x7f0ea414d5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e98000c00 tx=0x7f0e980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea17fa640 1 -- 172.21.15.103:0/3410581221 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98041020 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea17fa640 1 -- 172.21.15.103:0/3410581221 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e980306c0 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0ea17fa640 1 -- 172.21.15.103:0/3410581221 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98037040 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.633+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea415dee0 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.634+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea415c430 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.634+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea415bf40 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.635+0000 7f0ea17fa640 1 -- 172.21.15.103:0/3410581221 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0e98044020 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.635+0000 7f0ea17fa640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0e8806c2b0 0x7f0e8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.635+0000 7f0ea17fa640 1 -- 172.21.15.103:0/3410581221 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0e980ac040 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.635+0000 7f0ea3fff640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0e8806c2b0 0x7f0e8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.636+0000 7f0ea3fff640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0e8806c2b0 0x7f0e8806e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e90006fd0 tx=0x7f0e90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.640+0000 7f0ea17fa640 1 -- 172.21.15.103:0/3410581221 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0e9804b030 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.806+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ea415ed80 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.807+0000 7f0ea17fa640 1 -- 172.21.15.103:0/3410581221 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18670 (secure 0 0 0) 0x7f0e9807a3e0 con 0x7f0ea40cb1c0 2024-09-19T05:38:09.809 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:09.809 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:49.821955+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0e8806c2b0 msgr2=0x7f0e8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0e8806c2b0 0x7f0e8806e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e90006fd0 tx=0x7f0e90008040 comp rx=0 tx=0).stop 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea40cb1c0 msgr2=0x7f0ea414d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea40cb1c0 0x7f0ea414d5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e98000c00 tx=0x7f0e980046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 shutdown_connections 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0e8806c2b0 0x7f0e8806e770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ea415d6a0 0x7f0ea41506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ea4154f40 0x7f0ea41f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 --2- 172.21.15.103:0/3410581221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ea40cb1c0 0x7f0ea414d5b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 >> 172.21.15.103:0/3410581221 conn(0x7f0ea406bc10 msgr2=0x7f0ea40c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 shutdown_connections 2024-09-19T05:38:09.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.809+0000 7f0eaaf11640 1 -- 172.21.15.103:0/3410581221 wait complete. 2024-09-19T05:38:09.821 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T05:38:09.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:09.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.920+0000 7feb70f13640 1 Processor -- start 2024-09-19T05:38:09.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.920+0000 7feb70f13640 1 -- start start 2024-09-19T05:38:09.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb70f13640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb6c0cd380 0x7feb6c0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb70f13640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb70f13640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feb6c15af20 0x7feb6c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb70f13640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7feb6c0cbea0 con 0x7feb6c15af20 2024-09-19T05:38:09.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb70f13640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7feb6c0cb8f0 con 0x7feb6c0cd380 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb70f13640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c0cbbc0 con 0x7feb6c0ccd60 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feb6c15af20 0x7feb6c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feb6c15af20 0x7feb6c15b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46202/0 (socket says 172.21.15.103:46202) 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 -- 172.21.15.103:0/2955456655 learned_addr learned my addr 172.21.15.103:0/2955456655 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6a59c640 1 --2- 172.21.15.103:0/2955456655 >> v2:172.21.15.174:3300/0 conn(0x7feb6c0cd380 0x7feb6c0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb63fff640 1 --2- 172.21.15.103:0/2955456655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 -- 172.21.15.103:0/2955456655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 msgr2=0x7feb6c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 --2- 172.21.15.103:0/2955456655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c0b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 -- 172.21.15.103:0/2955456655 >> v2:172.21.15.174:3300/0 conn(0x7feb6c0cd380 msgr2=0x7feb6c0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:09.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 --2- 172.21.15.103:0/2955456655 >> v2:172.21.15.174:3300/0 conn(0x7feb6c0cd380 0x7feb6c0cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb6ad9d640 1 -- 172.21.15.103:0/2955456655 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c0c6780 con 0x7feb6c15af20 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.921+0000 7feb63fff640 1 --2- 172.21.15.103:0/2955456655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.922+0000 7feb6ad9d640 1 --2- 172.21.15.103:0/2955456655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c15b3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb6c08e490 tx=0x7feb6402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7685cc1ebd7643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.922+0000 7feb69d9b640 1 -- 172.21.15.103:0/2955456655 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb64036070 con 0x7feb6c15af20 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.922+0000 7feb69d9b640 1 -- 172.21.15.103:0/2955456655 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb64031600 con 0x7feb6c15af20 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.922+0000 7feb69d9b640 1 -- 172.21.15.103:0/2955456655 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640319d0 con 0x7feb6c15af20 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 -- 172.21.15.103:0/2955456655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 msgr2=0x7feb6c15b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 --2- 172.21.15.103:0/2955456655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c15b3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb6c08e490 tx=0x7feb6402a730 comp rx=0 tx=0).stop 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 -- 172.21.15.103:0/2955456655 shutdown_connections 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 --2- 172.21.15.103:0/2955456655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c15b3d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 --2- 172.21.15.103:0/2955456655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 --2- 172.21.15.103:0/2955456655 >> v2:172.21.15.174:3300/0 conn(0x7feb6c0cd380 0x7feb6c0cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 -- 172.21.15.103:0/2955456655 >> 172.21.15.103:0/2955456655 conn(0x7feb6c06d830 msgr2=0x7feb6c06dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:09.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 -- 172.21.15.103:0/2955456655 shutdown_connections 2024-09-19T05:38:09.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.923+0000 7feb70f13640 1 -- 172.21.15.103:0/2955456655 wait complete. 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.924+0000 7feb70f13640 1 Processor -- start 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.924+0000 7feb70f13640 1 -- start start 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb70f13640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb70f13640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb6c0cd380 0x7feb6c15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb70f13640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb70f13640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c0c7020 con 0x7feb6c15af20 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb70f13640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c0c6d40 con 0x7feb6c0cd380 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb70f13640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c0b4680 con 0x7feb6c0ccd60 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46216/0 (socket says 172.21.15.103:46216) 2024-09-19T05:38:09.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 -- 172.21.15.103:0/3748417478 learned_addr learned my addr 172.21.15.103:0/3748417478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6a59c640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb63fff640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb6c0cd380 0x7feb6c15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 -- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 msgr2=0x7feb6c1f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c1f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 -- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb6c0cd380 msgr2=0x7feb6c15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb6c0cd380 0x7feb6c15a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 -- 172.21.15.103:0/3748417478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c0cabe0 con 0x7feb6c15af20 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb63fff640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb6c0cd380 0x7feb6c15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb6ad9d640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c153c90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feb64009f40 tx=0x7feb64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb62ffd640 1 -- 172.21.15.103:0/3748417478 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb64036050 con 0x7feb6c15af20 2024-09-19T05:38:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb62ffd640 1 -- 172.21.15.103:0/3748417478 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb64042070 con 0x7feb6c15af20 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb62ffd640 1 -- 172.21.15.103:0/3748417478 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb64009510 con 0x7feb6c15af20 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.925+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6c0ca340 con 0x7feb6c15af20 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.926+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6c0ca900 con 0x7feb6c15af20 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.927+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6c150390 con 0x7feb6c15af20 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.927+0000 7feb62ffd640 1 -- 172.21.15.103:0/3748417478 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb64007bf0 con 0x7feb6c15af20 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.927+0000 7feb62ffd640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feb4c06c2b0 0x7feb4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.927+0000 7feb62ffd640 1 -- 172.21.15.103:0/3748417478 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feb640ac3e0 con 0x7feb6c15af20 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.927+0000 7feb6a59c640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feb4c06c2b0 0x7feb4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.928+0000 7feb6a59c640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feb4c06c2b0 0x7feb4c06e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009b40 tx=0x7feb5c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:09.932+0000 7feb62ffd640 1 -- 172.21.15.103:0/3748417478 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7feb6c150390 con 0x7feb6c15af20 2024-09-19T05:38:10.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.099+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb6c0c6320 con 0x7feb6c15af20 2024-09-19T05:38:10.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.100+0000 7feb62ffd640 1 -- 172.21.15.103:0/3748417478 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18670 (secure 0 0 0) 0x7feb6c0cabe0 con 0x7feb6c15af20 2024-09-19T05:38:10.101 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:10.101 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:37:49.821955+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:10.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feb4c06c2b0 msgr2=0x7feb4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feb4c06c2b0 0x7feb4c06e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009b40 tx=0x7feb5c009190 comp rx=0 tx=0).stop 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 msgr2=0x7feb6c153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c153c90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feb64009f40 tx=0x7feb64004a40 comp rx=0 tx=0).stop 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 shutdown_connections 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7feb4c06c2b0 0x7feb4c06e770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb6c15af20 0x7feb6c153c90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb6c0cd380 0x7feb6c15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 --2- 172.21.15.103:0/3748417478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6c0ccd60 0x7feb6c1f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 >> 172.21.15.103:0/3748417478 conn(0x7feb6c06d830 msgr2=0x7feb6c14d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 shutdown_connections 2024-09-19T05:38:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.102+0000 7feb70f13640 1 -- 172.21.15.103:0/3748417478 wait complete. 2024-09-19T05:38:10.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T05:38:10.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T05:38:10.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T05:38:10.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T05:38:10.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T05:38:10.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T05:38:10.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T05:38:10.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T05:38:10.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.284+0000 7f44e8f1a640 1 Processor -- start 2024-09-19T05:38:10.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.284+0000 7f243c92c640 1 Processor -- start 2024-09-19T05:38:10.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.284+0000 7ff68883c640 1 Processor -- start 2024-09-19T05:38:10.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.284+0000 7ff68883c640 1 -- start start 2024-09-19T05:38:10.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.285+0000 7f243c92c640 1 -- start start 2024-09-19T05:38:10.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.285+0000 7f44e8f1a640 1 -- start start 2024-09-19T05:38:10.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.285+0000 7f0bb9f28640 1 Processor -- start 2024-09-19T05:38:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7f0bb9f28640 1 -- start start 2024-09-19T05:38:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7ff68883c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6840b3540 0x7ff6840cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7ff68883c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 0x7ff6840cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7ff68883c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6840cbed0 con 0x7ff684155040 2024-09-19T05:38:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7ff68883c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff68415bd70 con 0x7ff6840b3540 2024-09-19T05:38:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7ff68883c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff6840cbbf0 con 0x7ff6840c5950 2024-09-19T05:38:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7f243c92c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f24381511f0 0x7f24380c2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7ff681d9b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6840b3540 0x7ff6840cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff681d9b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6840b3540 0x7ff6840cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34666/0 (socket says 172.21.15.103:34666) 2024-09-19T05:38:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff681d9b640 1 -- 172.21.15.103:0/3293509822 learned_addr learned my addr 172.21.15.103:0/3293509822 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff682d9d640 1 --2- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 0x7ff6840cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff681d9b640 1 -- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 msgr2=0x7ff6840cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff68159a640 1 -- 172.21.15.103:0/3293509822 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102614045 0 0) 0x7ff6840cbed0 con 0x7ff684155040 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0bb9f28640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0bb4152eb0 0x7f0bb406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0bb9f28640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0bb41591a0 0x7f0bb41595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0bb9f28640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb415c200 con 0x7f0bb406ce10 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0bb9f28640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb415c4c0 con 0x7f0bb41591a0 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0bb9f28640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb415c7a0 con 0x7f0bb4152eb0 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7f243c92c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243815a8d0 con 0x7f24380c8840 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f243c92c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243815ab90 con 0x7f24380c7ae0 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f2436d9d640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f24380c7ae0 0x7f2438161850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54056/0 (socket says 172.21.15.103:54056) 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f2436d9d640 1 -- 172.21.15.103:0/2139398194 learned_addr learned my addr 172.21.15.103:0/2139398194 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f243c92c640 1 -- 172.21.15.103:0/2139398194 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f243815b430 con 0x7f24381511f0 2024-09-19T05:38:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7f5047fff640 1 Processor -- start 2024-09-19T05:38:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7f452aa1e640 1 Processor -- start 2024-09-19T05:38:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.286+0000 7fbd72c1e640 1 Processor -- start 2024-09-19T05:38:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7fbd72c1e640 1 -- start start 2024-09-19T05:38:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f44e8f1a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e40744d0 0x7f44e40c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f44e8f1a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e415aba0 con 0x7f44e4070240 2024-09-19T05:38:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f44e8f1a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e415ae40 con 0x7f44e4067890 2024-09-19T05:38:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f44e8f1a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f44e41577d0 con 0x7f44e40744d0 2024-09-19T05:38:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f44e2d9d640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f44e4067890 0x7f44e41514b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54070/0 (socket says 172.21.15.103:54070) 2024-09-19T05:38:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f44e2d9d640 1 -- 172.21.15.103:0/343489130 learned_addr learned my addr 172.21.15.103:0/343489130 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0babfff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0bb406ce10 0x7f0bb40c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54078/0 (socket says 172.21.15.103:54078) 2024-09-19T05:38:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0babfff640 1 -- 172.21.15.103:0/448872685 learned_addr learned my addr 172.21.15.103:0/448872685 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f0bb3fff640 1 --2- 172.21.15.103:0/448872685 >> v2:172.21.15.103:3300/0 conn(0x7f0bb41591a0 0x7f0bb41595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f243659c640 1 --2- 172.21.15.103:0/2139398194 >> v2:172.21.15.103:3300/0 conn(0x7f24381511f0 0x7f24380c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7fdf416c8640 1 Processor -- start 2024-09-19T05:38:10.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f44e1d9b640 1 --2- 172.21.15.103:0/343489130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e40744d0 0x7f44e40c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f5047fff640 1 -- start start 2024-09-19T05:38:10.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f5047fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f504004a670 0x7f504004aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f44e1d9b640 1 -- 172.21.15.103:0/343489130 >> v1:172.21.15.174:6789/0 conn(0x7f44e4067890 legacy=0x7f44e41514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f44e1d9b640 1 -- 172.21.15.103:0/343489130 >> v1:172.21.15.103:6789/0 conn(0x7f44e4070240 legacy=0x7f44e40c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f0bb3fff640 1 -- 172.21.15.103:0/448872685 >> v2:172.21.15.174:3300/0 conn(0x7f0bb4152eb0 msgr2=0x7f0bb406c8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:38:10.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff681d9b640 1 --2- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 0x7ff6840cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff681d9b640 1 -- 172.21.15.103:0/3293509822 >> v1:172.21.15.174:6789/0 conn(0x7ff684155040 legacy=0x7ff68415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7ff681d9b640 1 -- 172.21.15.103:0/3293509822 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68415afb0 con 0x7ff6840b3540 2024-09-19T05:38:10.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038580010 0 0) 0x7f243815ab90 con 0x7f24380c7ae0 2024-09-19T05:38:10.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f44e1d9b640 1 -- 172.21.15.103:0/343489130 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e415b120 con 0x7f44e40744d0 2024-09-19T05:38:10.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7ff682d9d640 1 --2- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 0x7ff6840cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:10.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f0bb3fff640 1 --2- 172.21.15.103:0/448872685 >> v2:172.21.15.174:3300/0 conn(0x7f0bb4152eb0 0x7f0bb406c8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f0bb3fff640 1 -- 172.21.15.103:0/448872685 >> v1:172.21.15.174:6789/0 conn(0x7f0bb406ce10 legacy=0x7f0bb40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f0bb3fff640 1 -- 172.21.15.103:0/448872685 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb415ca80 con 0x7f0bb41591a0 2024-09-19T05:38:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2420003520 con 0x7f24380c7ae0 2024-09-19T05:38:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450722396 0 0) 0x7f243815a8d0 con 0x7f24380c8840 2024-09-19T05:38:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243815ab90 con 0x7f24380c8840 2024-09-19T05:38:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7fdf416c8640 1 -- start start 2024-09-19T05:38:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.287+0000 7f452aa1e640 1 -- start start 2024-09-19T05:38:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f452aa1e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45241596f0 0x7f4524163270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f452aa1e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f4524160690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f452aa1e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45240c7b00 con 0x7f452406f140 2024-09-19T05:38:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f452aa1e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f45240c7da0 con 0x7f45241596f0 2024-09-19T05:38:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f452aa1e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f45240c8080 con 0x7f452406f520 2024-09-19T05:38:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7fbd72c1e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06f140 0x7fbd6c157880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7ff681d9b640 1 --2- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6840b3540 0x7ff6840cb540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff674009e50 tx=0x7ff67402a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa075c480a5d576a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7fbd72c1e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd6c158340 0x7fbd6c150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7ff68159a640 1 -- 172.21.15.103:0/3293509822 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674036070 con 0x7ff6840b3540 2024-09-19T05:38:10.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7ff68159a640 1 -- 172.21.15.103:0/3293509822 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff674031600 con 0x7ff6840b3540 2024-09-19T05:38:10.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7ff68159a640 1 -- 172.21.15.103:0/3293509822 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6740319f0 con 0x7ff6840b3540 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2480535990 0 0) 0x7f243815ab90 con 0x7f24380c8840 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 >> v2:172.21.15.103:3300/0 conn(0x7f24381511f0 msgr2=0x7f24380c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 --2- 172.21.15.103:0/2139398194 >> v2:172.21.15.103:3300/0 conn(0x7f24381511f0 0x7f24380c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 >> v1:172.21.15.174:6789/0 conn(0x7f24380c7ae0 legacy=0x7f2438161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243815ae70 con 0x7f24380c8840 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f2428001520 con 0x7f24380c8840 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 >> v1:172.21.15.103:6789/0 conn(0x7f24380c8840 legacy=0x7f2438157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7f5047fff640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50400e6d20 con 0x7f50400e5f20 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f5047fff640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5040044f80 con 0x7f50400dcd80 2024-09-19T05:38:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f5047fff640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5040044d30 con 0x7f504004a670 2024-09-19T05:38:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4523fff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f452406f140 0x7f4524158fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54080/0 (socket says 172.21.15.103:54080) 2024-09-19T05:38:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4523fff640 1 -- 172.21.15.103:0/1246171657 learned_addr learned my addr 172.21.15.103:0/1246171657 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4528fbb640 1 --2- 172.21.15.103:0/1246171657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f4524160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.288+0000 7fbd709ba640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06f140 0x7fbd6c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fbd709ba640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06f140 0x7fbd6c157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46616/0 (socket says 172.21.15.103:46616) 2024-09-19T05:38:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fbd709ba640 1 -- 172.21.15.103:0/2360123702 learned_addr learned my addr 172.21.15.103:0/2360123702 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6c15b3a0 con 0x7fbd6c06f520 2024-09-19T05:38:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6c0c7cd0 con 0x7fbd6c158340 2024-09-19T05:38:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c157dc0 con 0x7fbd6c06f140 2024-09-19T05:38:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2420004bf0 0x7f2420004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f5046ffd640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f50400dcd80 0x7f5040045d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54096/0 (socket says 172.21.15.103:54096) 2024-09-19T05:38:10.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f5046ffd640 1 -- 172.21.15.103:0/1076611300 learned_addr learned my addr 172.21.15.103:0/1076611300 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f45237fe640 1 --2- 172.21.15.103:0/1246171657 >> v2:172.21.15.103:3300/0 conn(0x7f45241596f0 0x7f4524163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4522ffd640 1 -- 172.21.15.103:0/1246171657 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650926175 0 0) 0x7f45240c7b00 con 0x7f452406f140 2024-09-19T05:38:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4522ffd640 1 -- 172.21.15.103:0/1246171657 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f450c003520 con 0x7f452406f140 2024-09-19T05:38:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24200037a0 0x7f2420003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fdf416c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c0c5500 0x7fdf3c15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fdf416c8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15c620 0x7fdf3c1633a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fdf416c8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf3c1597b0 con 0x7fdf3c152e20 2024-09-19T05:38:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fdf416c8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3c159560 con 0x7fdf3c15c620 2024-09-19T05:38:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fdf416c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c159a90 con 0x7fdf3c0c5500 2024-09-19T05:38:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243659c640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2420004bf0 0x7f2420004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2420004360 0x7f2420005a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f243815b430 con 0x7f24200037a0 2024-09-19T05:38:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24200062f0 con 0x7f2420004bf0 2024-09-19T05:38:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4522ffd640 1 -- 172.21.15.103:0/1246171657 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 159901338 0 0) 0x7f450c003520 con 0x7f452406f140 2024-09-19T05:38:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4528fbb640 1 -- 172.21.15.103:0/1246171657 >> v2:172.21.15.103:3300/0 conn(0x7f45241596f0 msgr2=0x7f4524163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4528fbb640 1 --2- 172.21.15.103:0/1246171657 >> v2:172.21.15.103:3300/0 conn(0x7f45241596f0 0x7f4524163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4528fbb640 1 -- 172.21.15.103:0/1246171657 >> v1:172.21.15.174:6789/0 conn(0x7f452406f140 legacy=0x7f4524158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f4528fbb640 1 -- 172.21.15.103:0/1246171657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4524162790 con 0x7f452406f520 2024-09-19T05:38:10.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f24200064f0 con 0x7f2420004360 2024-09-19T05:38:10.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f0bb3fff640 1 --2- 172.21.15.103:0/448872685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb41591a0 0x7f0bb41595b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0bb406ff90 tx=0x7f0bac02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfcadd998013fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf40ec7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15c620 0x7fdf3c1633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7fbd711bb640 1 --2- 172.21.15.103:0/2360123702 >> v2:172.21.15.103:3300/0 conn(0x7fbd6c158340 0x7fbd6c150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.289+0000 7f50467fc640 1 --2- 172.21.15.103:0/1076611300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f504004a670 0x7f504004aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf40ec7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15c620 0x7fdf3c1633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34680/0 (socket says 172.21.15.103:34680) 2024-09-19T05:38:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf40ec7640 1 -- 172.21.15.103:0/4065928123 learned_addr learned my addr 172.21.15.103:0/4065928123 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fbd709ba640 1 -- 172.21.15.103:0/2360123702 >> v2:172.21.15.103:3300/0 conn(0x7fbd6c158340 msgr2=0x7fbd6c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fbd709ba640 1 --2- 172.21.15.103:0/2360123702 >> v2:172.21.15.103:3300/0 conn(0x7fbd6c158340 0x7fbd6c150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fbd709ba640 1 -- 172.21.15.103:0/2360123702 >> v1:172.21.15.174:6789/0 conn(0x7fbd6c06f520 legacy=0x7fbd6c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f50467fc640 1 -- 172.21.15.103:0/1076611300 >> v1:172.21.15.174:6789/0 conn(0x7f50400dcd80 legacy=0x7f5040045d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f50467fc640 1 -- 172.21.15.103:0/1076611300 >> v1:172.21.15.103:6789/0 conn(0x7f50400e5f20 legacy=0x7f50400e63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fbd709ba640 1 -- 172.21.15.103:0/2360123702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c0c7f30 con 0x7fbd6c06f140 2024-09-19T05:38:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f2436d9d640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2420004360 0x7f2420005a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f243659c640 1 -- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2420004360 msgr2=0x7f2420005a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f44e1d9b640 1 --2- 172.21.15.103:0/343489130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e40744d0 0x7f44e40c6ba0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f44d80097d0 tx=0x7f44d802a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d0f883c99355a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf3b7fe640 1 --2- 172.21.15.103:0/4065928123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c0c5500 0x7fdf3c15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f50467fc640 1 -- 172.21.15.103:0/1076611300 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5040045260 con 0x7f504004a670 2024-09-19T05:38:10.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f243659c640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2420004360 0x7f2420005a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 -- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6840b3540 msgr2=0x7ff6840cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 --2- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6840b3540 0x7ff6840cb540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff674009e50 tx=0x7ff67402a750 comp rx=0 tx=0).stop 2024-09-19T05:38:10.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f243659c640 1 -- 172.21.15.103:0/2139398194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24200037a0 msgr2=0x7f2420003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f2435d9b640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24200037a0 0x7f2420003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf3b7fe640 1 -- 172.21.15.103:0/4065928123 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15c620 msgr2=0x7fdf3c1633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf3b7fe640 1 --2- 172.21.15.103:0/4065928123 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15c620 0x7fdf3c1633a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf3b7fe640 1 -- 172.21.15.103:0/4065928123 >> v1:172.21.15.103:6789/0 conn(0x7fdf3c152e20 legacy=0x7fdf3c0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7fdf3b7fe640 1 -- 172.21.15.103:0/4065928123 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c0c5c10 con 0x7fdf3c0c5500 2024-09-19T05:38:10.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 -- 172.21.15.103:0/3293509822 shutdown_connections 2024-09-19T05:38:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 --2- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 0x7ff6840cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 --2- 172.21.15.103:0/3293509822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6840b3540 0x7ff6840cb540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 -- 172.21.15.103:0/3293509822 >> 172.21.15.103:0/3293509822 conn(0x7ff684073340 msgr2=0x7ff684073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f243659c640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24200037a0 0x7f2420003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 -- 172.21.15.103:0/3293509822 shutdown_connections 2024-09-19T05:38:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f243659c640 1 -- 172.21.15.103:0/2139398194 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243815ab90 con 0x7f2420004bf0 2024-09-19T05:38:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f4528fbb640 1 --2- 172.21.15.103:0/1246171657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f4524160690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45140097a0 tx=0x7f451402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd1b19e40854bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f44e159a640 1 -- 172.21.15.103:0/343489130 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8037070 con 0x7f44e40744d0 2024-09-19T05:38:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f44e159a640 1 -- 172.21.15.103:0/343489130 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d8032440 con 0x7f44e40744d0 2024-09-19T05:38:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f44e159a640 1 -- 172.21.15.103:0/343489130 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8032810 con 0x7f44e40744d0 2024-09-19T05:38:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f0bb2ffd640 1 -- 172.21.15.103:0/448872685 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac007740 con 0x7f0bb41591a0 2024-09-19T05:38:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7f0bb2ffd640 1 -- 172.21.15.103:0/448872685 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bac0078e0 con 0x7f0bb41591a0 2024-09-19T05:38:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f0bb2ffd640 1 -- 172.21.15.103:0/448872685 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac007cb0 con 0x7f0bb41591a0 2024-09-19T05:38:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f4522ffd640 1 -- 172.21.15.103:0/1246171657 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514037070 con 0x7f452406f520 2024-09-19T05:38:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f4522ffd640 1 -- 172.21.15.103:0/1246171657 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451402aba0 con 0x7f452406f520 2024-09-19T05:38:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f2436d9d640 1 -- 172.21.15.103:0/2139398194 reap_dead start 2024-09-19T05:38:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f4522ffd640 1 -- 172.21.15.103:0/1246171657 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518001690 con 0x7f452406f520 2024-09-19T05:38:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f50467fc640 1 --2- 172.21.15.103:0/1076611300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f504004a670 0x7f504004aa70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5038009750 tx=0x7f503802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1850912b419393ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.290+0000 7ff68883c640 1 -- 172.21.15.103:0/3293509822 wait complete. 2024-09-19T05:38:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f2435d9b640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24200037a0 0x7f2420003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f5045ffb640 1 -- 172.21.15.103:0/1076611300 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038037070 con 0x7f504004a670 2024-09-19T05:38:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7fdf3b7fe640 1 --2- 172.21.15.103:0/4065928123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c0c5500 0x7fdf3c15c0e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0097a0 tx=0x7fdf2c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=883161d8235a27ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f5045ffb640 1 -- 172.21.15.103:0/1076611300 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503802ae40 con 0x7f504004a670 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f5045ffb640 1 -- 172.21.15.103:0/1076611300 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038032660 con 0x7f504004a670 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f243659c640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2420004bf0 0x7f2420004ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f242c00a9a0 tx=0x7f2420005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1536cd7730c747 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f0bb9f28640 1 -- 172.21.15.103:0/448872685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb41591a0 msgr2=0x7f0bb41595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.291+0000 7f0bb9f28640 1 --2- 172.21.15.103:0/448872685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb41591a0 0x7f0bb41595b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0bb406ff90 tx=0x7f0bac02a6d0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f0bb9f28640 1 -- 172.21.15.103:0/448872685 shutdown_connections 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f0bb9f28640 1 --2- 172.21.15.103:0/448872685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb41591a0 0x7f0bb41595b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f0bb9f28640 1 --2- 172.21.15.103:0/448872685 >> v2:172.21.15.174:3300/0 conn(0x7f0bb4152eb0 0x7f0bb406c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f0bb9f28640 1 -- 172.21.15.103:0/448872685 >> 172.21.15.103:0/448872685 conn(0x7f0bb40cc730 msgr2=0x7f0bb40ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7fbd709ba640 1 --2- 172.21.15.103:0/2360123702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06f140 0x7fbd6c157880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31c26318dae72691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f0bb9f28640 1 -- 172.21.15.103:0/448872685 shutdown_connections 2024-09-19T05:38:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f44e8f1a640 1 -- 172.21.15.103:0/343489130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e40744d0 msgr2=0x7f44e40c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f44e8f1a640 1 --2- 172.21.15.103:0/343489130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e40744d0 0x7f44e40c6ba0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f44d80097d0 tx=0x7f44d802a2a0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f0bb9f28640 1 -- 172.21.15.103:0/448872685 wait complete. 2024-09-19T05:38:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c037070 con 0x7f2420004bf0 2024-09-19T05:38:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7fbd6b7fe640 1 -- 172.21.15.103:0/2360123702 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58037070 con 0x7fbd6c06f140 2024-09-19T05:38:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7fbd6b7fe640 1 -- 172.21.15.103:0/2360123702 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58032440 con 0x7fbd6c06f140 2024-09-19T05:38:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7fbd6b7fe640 1 -- 172.21.15.103:0/2360123702 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58032810 con 0x7fbd6c06f140 2024-09-19T05:38:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c02ab80 con 0x7f2420004bf0 2024-09-19T05:38:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 -- 172.21.15.103:0/1246171657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 msgr2=0x7f4524160690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 --2- 172.21.15.103:0/1246171657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f4524160690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45140097a0 tx=0x7f451402a110 comp rx=0 tx=0).stop 2024-09-19T05:38:10.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f44e8f1a640 1 -- 172.21.15.103:0/343489130 shutdown_connections 2024-09-19T05:38:10.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f44e8f1a640 1 --2- 172.21.15.103:0/343489130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e40744d0 0x7f44e40c6ba0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f44e8f1a640 1 -- 172.21.15.103:0/343489130 >> 172.21.15.103:0/343489130 conn(0x7f44e40ccf00 msgr2=0x7f44e40cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f44e8f1a640 1 -- 172.21.15.103:0/343489130 shutdown_connections 2024-09-19T05:38:10.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f243559a640 1 -- 172.21.15.103:0/2139398194 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c00a570 con 0x7f2420004bf0 2024-09-19T05:38:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7fdf3affd640 1 -- 172.21.15.103:0/4065928123 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c037070 con 0x7fdf3c0c5500 2024-09-19T05:38:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 -- 172.21.15.103:0/1246171657 shutdown_connections 2024-09-19T05:38:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 --2- 172.21.15.103:0/1246171657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f4524160690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 --2- 172.21.15.103:0/1246171657 >> v2:172.21.15.103:3300/0 conn(0x7f45241596f0 0x7f4524163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 -- 172.21.15.103:0/1246171657 >> 172.21.15.103:0/1246171657 conn(0x7f45240c9230 msgr2=0x7f45240c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7fdf3affd640 1 -- 172.21.15.103:0/4065928123 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c02ae40 con 0x7fdf3c0c5500 2024-09-19T05:38:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7fdf3affd640 1 -- 172.21.15.103:0/4065928123 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c037070 con 0x7fdf3c0c5500 2024-09-19T05:38:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 -- 172.21.15.103:0/1246171657 shutdown_connections 2024-09-19T05:38:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f44e8f1a640 1 -- 172.21.15.103:0/343489130 wait complete. 2024-09-19T05:38:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7ff68883c640 1 Processor -- start 2024-09-19T05:38:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7ff68883c640 1 -- start start 2024-09-19T05:38:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f5047fff640 1 -- 172.21.15.103:0/1076611300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f504004a670 msgr2=0x7f504004aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f5047fff640 1 --2- 172.21.15.103:0/1076611300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f504004a670 0x7f504004aa70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5038009750 tx=0x7f503802a130 comp rx=0 tx=0).stop 2024-09-19T05:38:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.292+0000 7f452aa1e640 1 -- 172.21.15.103:0/1246171657 wait complete. 2024-09-19T05:38:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f5047fff640 1 -- 172.21.15.103:0/1076611300 shutdown_connections 2024-09-19T05:38:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f5047fff640 1 --2- 172.21.15.103:0/1076611300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f504004a670 0x7f504004aa70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f5047fff640 1 -- 172.21.15.103:0/1076611300 >> 172.21.15.103:0/1076611300 conn(0x7f504004fc40 msgr2=0x7f5040050050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f243c92c640 1 -- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2420004bf0 msgr2=0x7f2420004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f243c92c640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2420004bf0 0x7f2420004ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f242c00a9a0 tx=0x7f2420005830 comp rx=0 tx=0).stop 2024-09-19T05:38:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06f140 msgr2=0x7fbd6c157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/2360123702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06f140 0x7fbd6c157880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5802a290 comp rx=0 tx=0).stop 2024-09-19T05:38:10.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f243c92c640 1 -- 172.21.15.103:0/2139398194 shutdown_connections 2024-09-19T05:38:10.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f243c92c640 1 --2- 172.21.15.103:0/2139398194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2420004bf0 0x7f2420004ff0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f243c92c640 1 -- 172.21.15.103:0/2139398194 >> 172.21.15.103:0/2139398194 conn(0x7f2438067ec0 msgr2=0x7f243806f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f5047fff640 1 -- 172.21.15.103:0/1076611300 shutdown_connections 2024-09-19T05:38:10.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7f5047fff640 1 -- 172.21.15.103:0/1076611300 wait complete. 2024-09-19T05:38:10.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 shutdown_connections 2024-09-19T05:38:10.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/2360123702 >> v2:172.21.15.103:3300/0 conn(0x7fbd6c158340 0x7fbd6c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/2360123702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06f140 0x7fbd6c157880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 >> 172.21.15.103:0/2360123702 conn(0x7fbd6c0c9230 msgr2=0x7fbd6c0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fdf416c8640 1 -- 172.21.15.103:0/4065928123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c0c5500 msgr2=0x7fdf3c15c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.293+0000 7fdf416c8640 1 --2- 172.21.15.103:0/4065928123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c0c5500 0x7fdf3c15c0e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0097a0 tx=0x7fdf2c02a130 comp rx=0 tx=0).stop 2024-09-19T05:38:10.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7f243c92c640 1 -- 172.21.15.103:0/2139398194 shutdown_connections 2024-09-19T05:38:10.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68883c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6840b3540 0x7ff68415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68883c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 0x7ff6841e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68883c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff684155040 0x7ff68415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7f452aa1e640 1 Processor -- start 2024-09-19T05:38:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7f0bb9f28640 1 Processor -- start 2024-09-19T05:38:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68883c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff68415b850 con 0x7ff6840b3540 2024-09-19T05:38:10.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68883c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff68415b570 con 0x7ff684155040 2024-09-19T05:38:10.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7f0bb9f28640 1 -- start start 2024-09-19T05:38:10.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6840b3540 0x7ff68415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68883c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff68415eb30 con 0x7ff6840c5950 2024-09-19T05:38:10.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6840b3540 0x7ff68415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46266/0 (socket says 172.21.15.103:46266) 2024-09-19T05:38:10.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68259c640 1 -- 172.21.15.103:0/3492542904 learned_addr learned my addr 172.21.15.103:0/3492542904 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7f452aa1e640 1 -- start start 2024-09-19T05:38:10.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7f243c92c640 1 -- 172.21.15.103:0/2139398194 wait complete. 2024-09-19T05:38:10.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7f44e8f1a640 1 Processor -- start 2024-09-19T05:38:10.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff682d9d640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff684155040 0x7ff68415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68259c640 1 -- 172.21.15.103:0/3492542904 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 msgr2=0x7ff6841e7ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:10.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.294+0000 7ff68259c640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6840c5950 0x7ff6841e7ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff68259c640 1 -- 172.21.15.103:0/3492542904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff684155040 msgr2=0x7ff68415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f44e8f1a640 1 -- start start 2024-09-19T05:38:10.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff68259c640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff684155040 0x7ff68415d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff68259c640 1 -- 172.21.15.103:0/3492542904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68415c5f0 con 0x7ff6840b3540 2024-09-19T05:38:10.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff68259c640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6840b3540 0x7ff68415c0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00c460 tx=0x7ff67c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c017070 con 0x7ff6840b3540 2024-09-19T05:38:10.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67c0035f0 con 0x7ff6840b3540 2024-09-19T05:38:10.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f452aa1e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f452406f140 0x7f4524072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f5047fff640 1 Processor -- start 2024-09-19T05:38:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f452aa1e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f45240ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0039e0 con 0x7ff6840b3540 2024-09-19T05:38:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff68883c640 1 -- 172.21.15.103:0/3492542904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68415dcd0 con 0x7ff6840b3540 2024-09-19T05:38:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7ff68883c640 1 -- 172.21.15.103:0/3492542904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6841f4d00 con 0x7ff6840b3540 2024-09-19T05:38:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f5047fff640 1 -- start start 2024-09-19T05:38:10.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f0bb9f28640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bb406ce10 0x7f0bb414d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 shutdown_connections 2024-09-19T05:38:10.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f0bb9f28640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb4152eb0 0x7f0bb4159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7fbd72c1e640 1 -- 172.21.15.103:0/2360123702 wait complete. 2024-09-19T05:38:10.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7fdf416c8640 1 -- 172.21.15.103:0/4065928123 shutdown_connections 2024-09-19T05:38:10.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7fdf416c8640 1 --2- 172.21.15.103:0/4065928123 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15c620 0x7fdf3c1633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7fdf416c8640 1 --2- 172.21.15.103:0/4065928123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c0c5500 0x7fdf3c15c0e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7fdf416c8640 1 -- 172.21.15.103:0/4065928123 >> 172.21.15.103:0/4065928123 conn(0x7fdf3c0731e0 msgr2=0x7fdf3c0735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb9f28640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bb41591a0 0x7f0bb4142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb9f28640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4159af0 con 0x7f0bb4152eb0 2024-09-19T05:38:10.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb9f28640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb415d040 con 0x7f0bb41591a0 2024-09-19T05:38:10.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb9f28640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb4153290 con 0x7f0bb406ce10 2024-09-19T05:38:10.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e8f1a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e4067890 0x7f44e4159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e8f1a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44e4070240 0x7f44e40c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bb41591a0 0x7f0bb4142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f243c92c640 1 Processor -- start 2024-09-19T05:38:10.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e259c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e4067890 0x7f44e4159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e259c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e4067890 0x7f44e4159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46686/0 (socket says 172.21.15.103:46686) 2024-09-19T05:38:10.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e1d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44e4070240 0x7f44e40c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e1d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44e4070240 0x7f44e40c16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34716/0 (socket says 172.21.15.103:34716) 2024-09-19T05:38:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e259c640 1 -- 172.21.15.103:0/452066195 learned_addr learned my addr 172.21.15.103:0/452066195 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb37fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bb406ce10 0x7f0bb414d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e8f1a640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40744d0 0x7f44e41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bb41591a0 0x7f0bb4142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34710/0 (socket says 172.21.15.103:34710) 2024-09-19T05:38:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f0bb3fff640 1 -- 172.21.15.103:0/2090632808 learned_addr learned my addr 172.21.15.103:0/2090632808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f44e8f1a640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f44e415b9c0 con 0x7f44e40744d0 2024-09-19T05:38:10.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5047fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504004a670 0x7f504016c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e8f1a640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f44e415b6e0 con 0x7f44e4070240 2024-09-19T05:38:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e8f1a640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f44e4067d40 con 0x7f44e4067890 2024-09-19T05:38:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5047fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400dcd80 0x7f50400dd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5047fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50400e5f20 0x7f50400dd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5046ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504004a670 0x7f504016c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5046ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504004a670 0x7f504016c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34724/0 (socket says 172.21.15.103:34724) 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f452aa1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45241596f0 0x7f4524150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f452aa1e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45240c75c0 con 0x7f45241596f0 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f452aa1e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4524162d50 con 0x7f452406f140 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.295+0000 7f452aa1e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f45240c7740 con 0x7f452406f520 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f45237fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f45240ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f45237fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f45240ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46684/0 (socket says 172.21.15.103:46684) 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f45237fe640 1 -- 172.21.15.103:0/233144095 learned_addr learned my addr 172.21.15.103:0/233144095 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f45237fe640 1 -- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f452406f140 msgr2=0x7f4524072170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f45237fe640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f452406f140 0x7f4524072170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f45237fe640 1 -- 172.21.15.103:0/233144095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45241596f0 msgr2=0x7f4524150ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f45237fe640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45241596f0 0x7f4524150ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5047fff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50400e6ac0 con 0x7f50400dcd80 2024-09-19T05:38:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5047fff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f50400dd160 con 0x7f504004a670 2024-09-19T05:38:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5047fff640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5040045820 con 0x7f50400e5f20 2024-09-19T05:38:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f5046ffd640 1 -- 172.21.15.103:0/939066620 learned_addr learned my addr 172.21.15.103:0/939066620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f45237fe640 1 -- 172.21.15.103:0/233144095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45241530b0 con 0x7f452406f520 2024-09-19T05:38:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e2d9d640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40744d0 0x7f44e41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f50477fe640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50400e5f20 0x7f50400dd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f45237fe640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f45240ca350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f451c007e60 tx=0x7f451c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f0bb37fe640 1 -- 172.21.15.103:0/2090632808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bb41591a0 msgr2=0x7f0bb4142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f0bb37fe640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bb41591a0 0x7f0bb4142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f0bb37fe640 1 -- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb4152eb0 msgr2=0x7f0bb4159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f0bb37fe640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb4152eb0 0x7f0bb4159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f50467fc640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400dcd80 0x7f50400dd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f0bb37fe640 1 -- 172.21.15.103:0/2090632808 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb414fa60 con 0x7f0bb406ce10 2024-09-19T05:38:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e259c640 1 -- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44e4070240 msgr2=0x7f44e40c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e259c640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44e4070240 0x7f44e40c16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e259c640 1 -- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40744d0 msgr2=0x7f44e41536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e259c640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40744d0 0x7f44e41536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e259c640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e4152d80 con 0x7f44e4067890 2024-09-19T05:38:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f0bb3fff640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bb41591a0 0x7f0bb4142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f44e2d9d640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40744d0 0x7f44e41536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7ff68883c640 1 -- 172.21.15.103:0/3492542904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff668001030 con 0x7ff6840b3540 2024-09-19T05:38:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c014620 con 0x7f452406f520 2024-09-19T05:38:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451c019070 con 0x7f452406f520 2024-09-19T05:38:10.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c0149c0 con 0x7f452406f520 2024-09-19T05:38:10.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.297+0000 7f452aa1e640 1 -- 172.21.15.103:0/233144095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45240716d0 con 0x7f452406f520 2024-09-19T05:38:10.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f452aa1e640 1 -- 172.21.15.103:0/233144095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4524152dd0 con 0x7f452406f520 2024-09-19T05:38:10.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7fbd72c1e640 1 Processor -- start 2024-09-19T05:38:10.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.296+0000 7f243c92c640 1 -- start start 2024-09-19T05:38:10.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f44e259c640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e4067890 0x7f44e4159710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c450 tx=0x7f44d400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f5046ffd640 1 -- 172.21.15.103:0/939066620 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50400e5f20 msgr2=0x7f50400dd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f5046ffd640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50400e5f20 0x7f50400dd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f5046ffd640 1 -- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400dcd80 msgr2=0x7f50400dd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f0bb37fe640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bb406ce10 0x7f0bb414d3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00b410 tx=0x7f0b9c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c015020 con 0x7f0bb406ce10 2024-09-19T05:38:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b9c011830 con 0x7f0bb406ce10 2024-09-19T05:38:10.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb415ac80 con 0x7f0bb406ce10 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243c92c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2420004bf0 0x7f24381f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243c92c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f243814cab0 0x7f2438155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243c92c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24381557d0 0x7f24381f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243c92c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f243815a520 con 0x7f2420004bf0 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243c92c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2438157150 con 0x7f243814cab0 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243c92c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2438156440 con 0x7f24381557d0 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2420004bf0 0x7f24381f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2420004bf0 0x7f24381f82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46294/0 (socket says 172.21.15.103:46294) 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f243659c640 1 -- 172.21.15.103:0/3611046278 learned_addr learned my addr 172.21.15.103:0/3611046278 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f2435d9b640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f243814cab0 0x7f2438155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f5046ffd640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400dcd80 0x7f50400dd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f5046ffd640 1 -- 172.21.15.103:0/939066620 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5040048530 con 0x7f504004a670 2024-09-19T05:38:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f50467fc640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400dcd80 0x7f50400dd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7fdf416c8640 1 -- 172.21.15.103:0/4065928123 shutdown_connections 2024-09-19T05:38:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7fdf416c8640 1 -- 172.21.15.103:0/4065928123 wait complete. 2024-09-19T05:38:10.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7fbd72c1e640 1 -- start start 2024-09-19T05:38:10.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243659c640 1 -- 172.21.15.103:0/3611046278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24381557d0 msgr2=0x7f24381f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243659c640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24381557d0 0x7f24381f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243659c640 1 -- 172.21.15.103:0/3611046278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f243814cab0 msgr2=0x7f2438155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d40052d0 con 0x7f44e4067890 2024-09-19T05:38:10.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d4005470 con 0x7f44e4067890 2024-09-19T05:38:10.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4012850 con 0x7f44e4067890 2024-09-19T05:38:10.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f44e8f1a640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e40c0c00 con 0x7f44e4067890 2024-09-19T05:38:10.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243659c640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f243814cab0 0x7f2438155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243659c640 1 -- 172.21.15.103:0/3611046278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2438156c90 con 0x7f2420004bf0 2024-09-19T05:38:10.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f44e8f1a640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e40c11c0 con 0x7f44e4067890 2024-09-19T05:38:10.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f5046ffd640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504004a670 0x7f504016c460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f504806ae50 tx=0x7f5048050ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243659c640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2420004bf0 0x7f24381f82c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f242c02a670 tx=0x7f242c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.298+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb414f260 con 0x7f0bb406ce10 2024-09-19T05:38:10.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c040020 con 0x7f2420004bf0 2024-09-19T05:38:10.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c011c20 con 0x7f0bb406ce10 2024-09-19T05:38:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7fbd72c1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd6c06f140 0x7fbd6c1ec980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bb4148ac0 con 0x7f0bb406ce10 2024-09-19T05:38:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24381f5ec0 con 0x7f2420004bf0 2024-09-19T05:38:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24381f8900 con 0x7f2420004bf0 2024-09-19T05:38:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c038040 con 0x7f2420004bf0 2024-09-19T05:38:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd709ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd6c06f140 0x7fbd6c1ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd709ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd6c06f140 0x7fbd6c1ec980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46296/0 (socket says 172.21.15.103:46296) 2024-09-19T05:38:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd709ba640 1 -- 172.21.15.103:0/3776637634 learned_addr learned my addr 172.21.15.103:0/3776637634 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd6c06f520 0x7fbd6c1e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.299+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff67c01a070 con 0x7ff6840b3540 2024-09-19T05:38:10.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c158340 0x7fbd6c159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048077570 con 0x7f504004a670 2024-09-19T05:38:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048092020 con 0x7f504004a670 2024-09-19T05:38:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50480743e0 con 0x7f504004a670 2024-09-19T05:38:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50400487f0 con 0x7f504004a670 2024-09-19T05:38:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd6bfff640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd6c06f520 0x7fbd6c1e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7ff67affd640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff66406c2b0 0x7ff66406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50400497d0 con 0x7f504004a670 2024-09-19T05:38:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c15aba0 con 0x7fbd6c06f140 2024-09-19T05:38:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fbd711bb640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c158340 0x7fbd6c159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44e40c6ba0 con 0x7f44e4067890 2024-09-19T05:38:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c15a8c0 con 0x7fbd6c06f520 2024-09-19T05:38:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c15ae80 con 0x7fbd6c158340 2024-09-19T05:38:10.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c037070 con 0x7f2420004bf0 2024-09-19T05:38:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7fdf416c8640 1 Processor -- start 2024-09-19T05:38:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.300+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff67c08abd0 con 0x7ff6840b3540 2024-09-19T05:38:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7ff67affd640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7ff664075a20 0x7ff664077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 --> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff664078530 con 0x7ff664075a20 2024-09-19T05:38:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50400e0da0 con 0x7f504004a670 2024-09-19T05:38:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff67c08f2a0 con 0x7ff6840b3540 2024-09-19T05:38:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7ff681d9b640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff66406c2b0 0x7ff66406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7ff682d9d640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7ff664075a20 0x7ff664077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.301+0000 7ff682d9d640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7ff664075a20 0x7ff664077e60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f451c014b60 con 0x7f452406f520 2024-09-19T05:38:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f241c001030 con 0x7f2420004bf0 2024-09-19T05:38:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7fbd6bfff640 1 -- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c158340 msgr2=0x7fbd6c159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7fbd6bfff640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c158340 0x7fbd6c159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7fbd6bfff640 1 -- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd6c06f140 msgr2=0x7fbd6c1ec980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7fbd6bfff640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd6c06f140 0x7fbd6c1ec980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7fbd6bfff640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c1e0420 con 0x7fbd6c06f520 2024-09-19T05:38:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7fbd709ba640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd6c06f140 0x7fbd6c1ec980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7fdf416c8640 1 -- start start 2024-09-19T05:38:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7ff681d9b640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff66406c2b0 0x7ff66406e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff674033000 tx=0x7ff674009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f242c043020 con 0x7f2420004bf0 2024-09-19T05:38:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0b9c018020 con 0x7f0bb406ce10 2024-09-19T05:38:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fbd6bfff640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd6c06f520 0x7fbd6c1e0c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c410 tx=0x7fbd6000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== osd.0 v2:172.21.15.103:6800/3619190800 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff664078530 con 0x7ff664075a20 2024-09-19T05:38:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5048074580 con 0x7f504004a670 2024-09-19T05:38:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60017070 con 0x7fbd6c06f520 2024-09-19T05:38:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd60005230 con 0x7fbd6c06f520 2024-09-19T05:38:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60017070 con 0x7fbd6c06f520 2024-09-19T05:38:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c0c7530 con 0x7fbd6c06f520 2024-09-19T05:38:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f452aa1e640 1 -- 172.21.15.103:0/233144095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4524151000 con 0x7f452406f520 2024-09-19T05:38:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.302+0000 7f4520ff9640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f451006c380 0x7f451006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f451c08bf20 con 0x7f452406f520 2024-09-19T05:38:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f4520ff9640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f4510075a80 0x7f4510077ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 --> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f451c014e50 con 0x7f4510075a80 2024-09-19T05:38:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f451c055ed0 con 0x7f452406f520 2024-09-19T05:38:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f2426ffd640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f241806c380 0x7f241806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c0730a0 con 0x7fbd6c06f520 2024-09-19T05:38:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f4528fbb640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f4510075a80 0x7f4510077ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f44d40129f0 con 0x7f44e4067890 2024-09-19T05:38:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f44d2ffd640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f44c406c380 0x7f44c406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fdf416c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf3c0c5500 0x7fdf3c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fdf416c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf3c152e20 0x7fdf3c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fdf416c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c15c620 0x7fdf3c14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fdf416c8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c0c61d0 con 0x7fdf3c152e20 2024-09-19T05:38:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fdf416c8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c15cad0 con 0x7fdf3c0c5500 2024-09-19T05:38:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7fdf416c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c153200 con 0x7fdf3c15c620 2024-09-19T05:38:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f44d408b280 con 0x7f44e4067890 2024-09-19T05:38:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f44d2ffd640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f44c4075a70 0x7f44c4077eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44c4078580 con 0x7f44c4075a70 2024-09-19T05:38:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f4523fff640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f451006c380 0x7f451006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f44e1d9b640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f44c406c380 0x7f44c406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f44e2d9d640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f44c4075a70 0x7f44c4077eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f502f7fe640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f503406c380 0x7f503406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f44d4092050 con 0x7f44e4067890 2024-09-19T05:38:10.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5048107a50 con 0x7f504004a670 2024-09-19T05:38:10.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f502f7fe640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7f5034075a70 0x7f5034077eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f0bb0ff9640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0b9406c2b0 0x7f0b9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.303+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0b9c08bcf0 con 0x7f0bb406ce10 2024-09-19T05:38:10.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f0bb0ff9640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f0b94075a30 0x7f0b94077e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 --> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b9c0067d0 con 0x7f0b94075a30 2024-09-19T05:38:10.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f4528fbb640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f4510075a80 0x7f4510077ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f4523fff640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f451006c380 0x7f451006e840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45240c7cd0 tx=0x7f45180010c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0b9c08c0e0 con 0x7f0bb406ce10 2024-09-19T05:38:10.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f0bb3fff640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f0b94075a30 0x7f0b94077e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.304+0000 7f0babfff640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0b9406c2b0 0x7f0b9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f50477fe640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7f5034075a70 0x7f5034077eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f44e2d9d640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f44c4075a70 0x7f44c4077eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f44e1d9b640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f44c406c380 0x7f44c406e840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44d8034000 tx=0x7f44d802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f0bb3fff640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f0b94075a30 0x7f0b94077e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 --> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f504809aeb0 con 0x7f5034075a70 2024-09-19T05:38:10.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f50467fc640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f503406c380 0x7f503406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf3c0c5500 0x7fdf3c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f0babfff640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0b9406c2b0 0x7f0b9406e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4007fd0 tx=0x7f0ba4007aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f2435d9b640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f241806c380 0x7f241806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf3c152e20 0x7fdf3c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf3c0c5500 0x7fdf3c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34744/0 (socket says 172.21.15.103:34744) 2024-09-19T05:38:10.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf40ec7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c15c620 0x7fdf3c14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3bfff640 1 -- 172.21.15.103:0/288720001 learned_addr learned my addr 172.21.15.103:0/288720001 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf3c152e20 0x7fdf3c14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46300/0 (socket says 172.21.15.103:46300) 2024-09-19T05:38:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd4c001030 con 0x7fbd6c06f520 2024-09-19T05:38:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f50480d1b40 con 0x7f504004a670 2024-09-19T05:38:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3bfff640 1 -- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c15c620 msgr2=0x7fdf3c14b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3bfff640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf3c15c620 0x7fdf3c14b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7fdf3bfff640 1 -- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf3c152e20 msgr2=0x7fdf3c14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.305+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== osd.5 v2:172.21.15.174:6808/2844736294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f451c014e50 con 0x7f4510075a80 2024-09-19T05:38:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== osd.1 v2:172.21.15.103:6808/2116552185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b9c0067d0 con 0x7f0b94075a30 2024-09-19T05:38:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f242c0abc30 con 0x7f2420004bf0 2024-09-19T05:38:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f2426ffd640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f2418075af0 0x7f2418077f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 --> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f242c02ab80 con 0x7f2418075af0 2024-09-19T05:38:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f2435d9b640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f241806c380 0x7f241806e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2438155760 tx=0x7f2428009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f242c0ae290 con 0x7f2420004bf0 2024-09-19T05:38:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== osd.7 v2:172.21.15.174:6800/3833416163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44c4078580 con 0x7f44c4075a70 2024-09-19T05:38:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd6001a070 con 0x7fbd6c06f520 2024-09-19T05:38:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7fdf3bfff640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf3c152e20 0x7fdf3c14b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7fdf3bfff640 1 -- 172.21.15.103:0/288720001 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c15b9e0 con 0x7fdf3c0c5500 2024-09-19T05:38:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7fdf3b7fe640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf3c152e20 0x7fdf3c14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f50477fe640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7f5034075a70 0x7f5034077eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f2436d9d640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f2418075af0 0x7f2418077f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7fdf3bfff640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf3c0c5500 0x7fdf3c15af00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400ba50 tx=0x7fdf3400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7f50467fc640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f503406c380 0x7f503406e840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5038034000 tx=0x7f503802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34019070 con 0x7fdf3c0c5500 2024-09-19T05:38:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3400cc10 con 0x7fdf3c0c5500 2024-09-19T05:38:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34014440 con 0x7fdf3c0c5500 2024-09-19T05:38:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.306+0000 7fbd697fa640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbd5006c6b0 0x7fbd5006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fbd709ba640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbd5006c6b0 0x7fbd5006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7f2436d9d640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f2418075af0 0x7f2418077f30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbd60005030 con 0x7fbd6c06f520 2024-09-19T05:38:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fbd697fa640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fbd50075cb0 0x7fbd500780f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd500787c0 con 0x7fbd50075cb0 2024-09-19T05:38:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbd60091050 con 0x7fbd6c06f520 2024-09-19T05:38:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.308+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== osd.2 v2:172.21.15.103:6824/2608335916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f242c02ab80 con 0x7f2418075af0 2024-09-19T05:38:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.307+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== osd.3 v2:172.21.15.103:6816/2269860310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f504809aeb0 con 0x7f5034075a70 2024-09-19T05:38:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.308+0000 7fdf416c8640 1 -- 172.21.15.103:0/288720001 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c15bcc0 con 0x7fdf3c0c5500 2024-09-19T05:38:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.308+0000 7fbd709ba640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbd5006c6b0 0x7fbd5006eb70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd5802a2d0 tx=0x7fbd5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.308+0000 7fbd711bb640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fbd50075cb0 0x7fbd500780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.308+0000 7fdf416c8640 1 -- 172.21.15.103:0/288720001 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c14aaf0 con 0x7fdf3c0c5500 2024-09-19T05:38:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.309+0000 7fbd711bb640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fbd50075cb0 0x7fbd500780f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.309+0000 7fdf416c8640 1 -- 172.21.15.103:0/288720001 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf3c071660 con 0x7fdf3c0c5500 2024-09-19T05:38:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.310+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== osd.6 v2:172.21.15.174:6816/2338063485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd500787c0 con 0x7fbd50075cb0 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.310+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf3401c070 con 0x7fdf3c0c5500 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.311+0000 7fdf38ff9640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdf1c06c380 0x7fdf1c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.311+0000 7fdf3b7fe640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdf1c06c380 0x7fdf1c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.311+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdf3408b520 con 0x7fdf3c0c5500 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.311+0000 7fdf38ff9640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fdf1c075af0 0x7fdf1c077f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.311+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 --> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf1c078600 con 0x7fdf1c075af0 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.311+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf34092050 con 0x7fdf3c0c5500 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.312+0000 7fdf3b7fe640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdf1c06c380 0x7fdf1c06e840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c034000 tx=0x7fdf2c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.312+0000 7fdf40ec7640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fdf1c075af0 0x7fdf1c077f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.313+0000 7fdf40ec7640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fdf1c075af0 0x7fdf1c077f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.314+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== osd.4 v2:172.21.15.174:6824/1847922711 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf1c078600 con 0x7fdf1c075af0 2024-09-19T05:38:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.334+0000 7ff68883c640 1 -- 172.21.15.103:0/3492542904 --> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff668002dd0 con 0x7ff664075a20 2024-09-19T05:38:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.335+0000 7ff67affd640 1 -- 172.21.15.103:0/3492542904 <== osd.0 v2:172.21.15.103:6800/3619190800 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff668002dd0 con 0x7ff664075a20 2024-09-19T05:38:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.336+0000 7ff678ff9640 1 -- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7ff664075a20 msgr2=0x7ff664077e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.336+0000 7ff678ff9640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7ff664075a20 0x7ff664077e60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.336+0000 7ff678ff9640 1 -- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff66406c2b0 msgr2=0x7ff66406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.336+0000 7ff678ff9640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff66406c2b0 0x7ff66406e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff674033000 tx=0x7ff674009000 comp rx=0 tx=0).stop 2024-09-19T05:38:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.336+0000 7ff678ff9640 1 -- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6840b3540 msgr2=0x7ff68415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.336+0000 7ff678ff9640 1 --2- 172.21.15.103:0/3492542904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6840b3540 0x7ff68415c0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00c460 tx=0x7ff67c00c920 comp rx=0 tx=0).stop 2024-09-19T05:38:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.336+0000 7f452aa1e640 1 -- 172.21.15.103:0/233144095 --> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45240c8890 con 0x7f4510075a80 2024-09-19T05:38:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7ff682d9d640 1 -- 172.21.15.103:0/3492542904 reap_dead start 2024-09-19T05:38:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7ff678ff9640 1 -- 172.21.15.103:0/3492542904 shutdown_connections 2024-09-19T05:38:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7ff678ff9640 1 -- 172.21.15.103:0/3492542904 >> 172.21.15.103:0/3492542904 conn(0x7ff684073340 msgr2=0x7ff684152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 --> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44e4072ae0 con 0x7f44c4075a70 2024-09-19T05:38:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7ff678ff9640 1 -- 172.21.15.103:0/3492542904 shutdown_connections 2024-09-19T05:38:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 --> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bb414f0a0 con 0x7f0b94075a30 2024-09-19T05:38:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7ff678ff9640 1 -- 172.21.15.103:0/3492542904 wait complete. 2024-09-19T05:38:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 --> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f241c002dd0 con 0x7f2418075af0 2024-09-19T05:38:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7f4520ff9640 1 -- 172.21.15.103:0/233144095 <== osd.5 v2:172.21.15.174:6808/2844736294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f45240c8890 con 0x7f4510075a80 2024-09-19T05:38:10.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.337+0000 7f44d2ffd640 1 -- 172.21.15.103:0/452066195 <== osd.7 v2:172.21.15.174:6800/3833416163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f44e4072ae0 con 0x7f44c4075a70 2024-09-19T05:38:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f2426ffd640 1 -- 172.21.15.103:0/3611046278 <== osd.2 v2:172.21.15.103:6824/2608335916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f241c002dd0 con 0x7f2418075af0 2024-09-19T05:38:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 --> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f50400e2bd0 con 0x7f5034075a70 2024-09-19T05:38:10.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 -- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f4510075a80 msgr2=0x7f4510077ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f4510075a80 0x7f4510077ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f44c4075a70 msgr2=0x7f44c4077eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f44d0ff9640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f44c4075a70 0x7f44c4077eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f0bb0ff9640 1 -- 172.21.15.103:0/2090632808 <== osd.1 v2:172.21.15.103:6808/2116552185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0bac000fb0 con 0x7f0b94075a30 2024-09-19T05:38:10.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 -- 172.21.15.103:0/233144095 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f451006c380 msgr2=0x7f451006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f451006c380 0x7f451006e840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45240c7cd0 tx=0x7f45180010c0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f44c406c380 msgr2=0x7f44c406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f44d0ff9640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f44c406c380 0x7f44c406e840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44d8034000 tx=0x7f44d802e000 comp rx=0 tx=0).stop 2024-09-19T05:38:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 -- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 msgr2=0x7f45240ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 --2- 172.21.15.103:0/233144095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f452406f520 0x7f45240ca350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f451c007e60 tx=0x7f451c00e4b0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f4528fbb640 1 -- 172.21.15.103:0/233144095 reap_dead start 2024-09-19T05:38:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e4067890 msgr2=0x7f44e4159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f44d0ff9640 1 --2- 172.21.15.103:0/452066195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44e4067890 0x7f44e4159710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c450 tx=0x7f44d400c910 comp rx=0 tx=0).stop 2024-09-19T05:38:10.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 -- 172.21.15.103:0/233144095 shutdown_connections 2024-09-19T05:38:10.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f450a7fc640 1 -- 172.21.15.103:0/233144095 >> 172.21.15.103:0/233144095 conn(0x7f45240c9230 msgr2=0x7f4524158420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f44e2d9d640 1 -- 172.21.15.103:0/452066195 reap_dead start 2024-09-19T05:38:10.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f0b94075a30 msgr2=0x7f0b94077e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f0b94075a30 0x7f0b94077e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f2418075af0 msgr2=0x7f2418077f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.338+0000 7f243c92c640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f2418075af0 0x7f2418077f30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f241806c380 msgr2=0x7f241806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f241806c380 0x7f241806e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2438155760 tx=0x7f2428009040 comp rx=0 tx=0).stop 2024-09-19T05:38:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2420004bf0 msgr2=0x7f24381f82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 --2- 172.21.15.103:0/3611046278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2420004bf0 0x7f24381f82c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f242c02a670 tx=0x7f242c004730 comp rx=0 tx=0).stop 2024-09-19T05:38:10.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f450a7fc640 1 -- 172.21.15.103:0/233144095 shutdown_connections 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 shutdown_connections 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 >> 172.21.15.103:0/452066195 conn(0x7f44e40ccf00 msgr2=0x7f44e414fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f450a7fc640 1 -- 172.21.15.103:0/233144095 wait complete. 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f2436d9d640 1 -- 172.21.15.103:0/3611046278 reap_dead start 2024-09-19T05:38:10.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 shutdown_connections 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f502f7fe640 1 -- 172.21.15.103:0/939066620 <== osd.3 v2:172.21.15.103:6816/2269860310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f50400e2bd0 con 0x7f5034075a70 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 >> 172.21.15.103:0/3611046278 conn(0x7f2438067ec0 msgr2=0x7f243814f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0b9406c2b0 msgr2=0x7f0b9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0b9406c2b0 0x7f0b9406e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4007fd0 tx=0x7f0ba4007aa0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bb406ce10 msgr2=0x7f0bb414d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 --2- 172.21.15.103:0/2090632808 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bb406ce10 0x7f0bb414d3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00b410 tx=0x7f0b9c00b8d0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb3fff640 1 -- 172.21.15.103:0/2090632808 reap_dead start 2024-09-19T05:38:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 shutdown_connections 2024-09-19T05:38:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 >> 172.21.15.103:0/2090632808 conn(0x7f0bb40cc730 msgr2=0x7f0bb4071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 shutdown_connections 2024-09-19T05:38:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f243c92c640 1 -- 172.21.15.103:0/3611046278 wait complete. 2024-09-19T05:38:10.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 shutdown_connections 2024-09-19T05:38:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 shutdown_connections 2024-09-19T05:38:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7f5034075a70 msgr2=0x7f5034077eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f5047fff640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7f5034075a70 0x7f5034077eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f44d0ff9640 1 -- 172.21.15.103:0/452066195 wait complete. 2024-09-19T05:38:10.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.339+0000 7f0bb9f28640 1 -- 172.21.15.103:0/2090632808 wait complete. 2024-09-19T05:38:10.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f503406c380 msgr2=0x7f503406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f503406c380 0x7f503406e840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5038034000 tx=0x7f503802e000 comp rx=0 tx=0).stop 2024-09-19T05:38:10.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504004a670 msgr2=0x7f504016c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 --2- 172.21.15.103:0/939066620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504004a670 0x7f504016c460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f504806ae50 tx=0x7f5048050ea0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f50477fe640 1 -- 172.21.15.103:0/939066620 reap_dead start 2024-09-19T05:38:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 shutdown_connections 2024-09-19T05:38:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 >> 172.21.15.103:0/939066620 conn(0x7f504004fc40 msgr2=0x7f504004c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 shutdown_connections 2024-09-19T05:38:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7f5047fff640 1 -- 172.21.15.103:0/939066620 wait complete. 2024-09-19T05:38:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.340+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 --> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd4c002dd0 con 0x7fbd50075cb0 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.341+0000 7fbd697fa640 1 -- 172.21.15.103:0/3776637634 <== osd.6 v2:172.21.15.174:6816/2338063485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd4c002dd0 con 0x7fbd50075cb0 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fbd50075cb0 msgr2=0x7fbd500780f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fbd50075cb0 0x7fbd500780f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbd5006c6b0 msgr2=0x7fbd5006eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbd5006c6b0 0x7fbd5006eb70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd5802a2d0 tx=0x7fbd5802e000 comp rx=0 tx=0).stop 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd6c06f520 msgr2=0x7fbd6c1e0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 --2- 172.21.15.103:0/3776637634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd6c06f520 0x7fbd6c1e0c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c410 tx=0x7fbd6000c8d0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd711bb640 1 -- 172.21.15.103:0/3776637634 reap_dead start 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 shutdown_connections 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 >> 172.21.15.103:0/3776637634 conn(0x7fbd6c0c9230 msgr2=0x7fbd6c0c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.342+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 shutdown_connections 2024-09-19T05:38:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.343+0000 7fbd72c1e640 1 -- 172.21.15.103:0/3776637634 wait complete. 2024-09-19T05:38:10.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.343+0000 7fdf416c8640 1 -- 172.21.15.103:0/288720001 --> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf3c071a00 con 0x7fdf1c075af0 2024-09-19T05:38:10.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.344+0000 7fdf38ff9640 1 -- 172.21.15.103:0/288720001 <== osd.4 v2:172.21.15.174:6824/1847922711 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf3c071a00 con 0x7fdf1c075af0 2024-09-19T05:38:10.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.345+0000 7fdf327fc640 1 -- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fdf1c075af0 msgr2=0x7fdf1c077f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.345+0000 7fdf327fc640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fdf1c075af0 0x7fdf1c077f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.346+0000 7fdf327fc640 1 -- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdf1c06c380 msgr2=0x7fdf1c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.346+0000 7fdf327fc640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdf1c06c380 0x7fdf1c06e840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c034000 tx=0x7fdf2c02e000 comp rx=0 tx=0).stop 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.346+0000 7fdf327fc640 1 -- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf3c0c5500 msgr2=0x7fdf3c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.346+0000 7fdf327fc640 1 --2- 172.21.15.103:0/288720001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf3c0c5500 0x7fdf3c15af00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400ba50 tx=0x7fdf3400bf10 comp rx=0 tx=0).stop 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.346+0000 7fdf40ec7640 1 -- 172.21.15.103:0/288720001 reap_dead start 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.346+0000 7fdf327fc640 1 -- 172.21.15.103:0/288720001 shutdown_connections 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.346+0000 7fdf327fc640 1 -- 172.21.15.103:0/288720001 >> 172.21.15.103:0/288720001 conn(0x7fdf3c0731e0 msgr2=0x7fdf3c1675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.347+0000 7fdf327fc640 1 -- 172.21.15.103:0/288720001 shutdown_connections 2024-09-19T05:38:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.347+0000 7fdf327fc640 1 -- 172.21.15.103:0/288720001 wait complete. 2024-09-19T05:38:10.408 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-09-19T05:38:10.408 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T05:38:10.409 INFO:teuthology.orchestra.run.smithi103.stdout:55834574859 2024-09-19T05:38:10.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T05:38:10.410 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:10.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T05:38:10.411 INFO:teuthology.orchestra.run.smithi103.stdout:60129542155 2024-09-19T05:38:10.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T05:38:10.412 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:10.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T05:38:10.413 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:10.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T05:38:10.414 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-09-19T05:38:10.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T05:38:10.415 INFO:teuthology.orchestra.run.smithi103.stdout:60129542155 2024-09-19T05:38:10.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T05:38:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.614+0000 7fb7ce374640 1 Processor -- start 2024-09-19T05:38:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.615+0000 7fb7ce374640 1 -- start start 2024-09-19T05:38:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.615+0000 7f653e88d640 1 Processor -- start 2024-09-19T05:38:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.615+0000 7fcd53fff640 1 Processor -- start 2024-09-19T05:38:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.615+0000 7fcd53fff640 1 -- start start 2024-09-19T05:38:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7ce374640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c000ed90 0x7fb7c0049930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7f653e88d640 1 -- start start 2024-09-19T05:38:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7f1cd31b9640 1 Processor -- start 2024-09-19T05:38:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7f1cd31b9640 1 -- start start 2024-09-19T05:38:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7f011bf31640 1 Processor -- start 2024-09-19T05:38:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd53fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd54152960 0x7fcd54073680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7ce374640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb7c004fe40 0x7fb7c0049e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7cd372640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb7c00dcce0 0x7fb7c0006380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53406/0 (socket says 172.21.15.103:53406) 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7ccb71640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c000ed90 0x7fb7c0049930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7ccb71640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c000ed90 0x7fb7c0049930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46728/0 (socket says 172.21.15.103:46728) 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7ce374640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c00e6030 con 0x7fb7c00dcce0 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7ce374640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c0048f40 con 0x7fb7c004fe40 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.616+0000 7fb7ce374640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c0049750 con 0x7fb7c000ed90 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fb7cd372640 1 -- 172.21.15.103:0/1286832084 learned_addr learned my addr 172.21.15.103:0/1286832084 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fb7ccb71640 1 -- 172.21.15.103:0/1286832084 >> v2:172.21.15.103:3300/0 conn(0x7fb7c004fe40 msgr2=0x7fb7c0049e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fb7ccb71640 1 --2- 172.21.15.103:0/1286832084 >> v2:172.21.15.103:3300/0 conn(0x7fb7c004fe40 0x7fb7c0049e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fb7ccb71640 1 -- 172.21.15.103:0/1286832084 >> v1:172.21.15.103:6789/0 conn(0x7fb7c00dcce0 legacy=0x7fb7c0006380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fb7ccb71640 1 -- 172.21.15.103:0/1286832084 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c00504a0 con 0x7fb7c000ed90 2024-09-19T05:38:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd53fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd540c5250 0x7fcd5406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7f011bf31640 1 -- start start 2024-09-19T05:38:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7f42385c4640 1 Processor -- start 2024-09-19T05:38:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f653e88d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6538154f40 0x7f65380c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd31b9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ccc15b490 0x7f1ccc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd31b9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc152200 0x7f1ccc162550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd31b9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ccc15bff0 con 0x7f1ccc15b870 2024-09-19T05:38:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd31b9640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f1ccc15bd50 con 0x7f1ccc15b490 2024-09-19T05:38:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f6537fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6538154f40 0x7f65380c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f6537fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6538154f40 0x7f65380c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46304/0 (socket says 172.21.15.103:46304) 2024-09-19T05:38:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f6537fff640 1 -- 172.21.15.103:0/3846971050 learned_addr learned my addr 172.21.15.103:0/3846971050 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f011bf31640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0114070b50 0x7f0114160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f011bf31640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0114073650 con 0x7f01141610d0 2024-09-19T05:38:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f011bf31640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01140725d0 con 0x7f011406be80 2024-09-19T05:38:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f011bf31640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0114163ae0 con 0x7f0114070b50 2024-09-19T05:38:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f01194cc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0114070b50 0x7f0114160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f01194cc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0114070b50 0x7f0114160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46314/0 (socket says 172.21.15.103:46314) 2024-09-19T05:38:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f01194cc640 1 -- 172.21.15.103:0/1612039214 learned_addr learned my addr 172.21.15.103:0/1612039214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd31b9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1ccc159c40 con 0x7f1ccc152200 2024-09-19T05:38:10.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd0f55640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ccc15b490 0x7f1ccc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd0f55640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ccc15b490 0x7f1ccc15aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34756/0 (socket says 172.21.15.103:34756) 2024-09-19T05:38:10.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd0f55640 1 -- 172.21.15.103:0/2928960759 learned_addr learned my addr 172.21.15.103:0/2928960759 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f1cd1756640 1 --2- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc152200 0x7f1ccc162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f653e88d640 1 --2- 172.21.15.103:0/3846971050 >> v2:172.21.15.174:3300/0 conn(0x7f6538155320 0x7f65380cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd53fff640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd54158a90 con 0x7fcd5406bc10 2024-09-19T05:38:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd53fff640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcd54073d10 con 0x7fcd54152960 2024-09-19T05:38:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd53fff640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcd541596a0 con 0x7fcd540c5250 2024-09-19T05:38:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd537fe640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fcd5406bc10 0x7fcd5415bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54116/0 (socket says 172.21.15.103:54116) 2024-09-19T05:38:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd537fe640 1 -- 172.21.15.103:0/878827195 learned_addr learned my addr 172.21.15.103:0/878827195 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.617+0000 7fcd527fc640 1 --2- 172.21.15.103:0/878827195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd540c5250 0x7fcd5406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f653e88d640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653815ed80 0x7f65380d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7fcd527fc640 1 -- 172.21.15.103:0/878827195 >> v2:172.21.15.103:3300/0 conn(0x7fcd54152960 msgr2=0x7fcd54073680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7fcd527fc640 1 --2- 172.21.15.103:0/878827195 >> v2:172.21.15.103:3300/0 conn(0x7fcd54152960 0x7fcd54073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7fcd527fc640 1 -- 172.21.15.103:0/878827195 >> v1:172.21.15.174:6789/0 conn(0x7fcd5406bc10 legacy=0x7fcd5415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7fcd527fc640 1 -- 172.21.15.103:0/878827195 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd54158d70 con 0x7fcd540c5250 2024-09-19T05:38:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f65380cb830 con 0x7f6538154f40 2024-09-19T05:38:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f1cd0f55640 1 -- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc152200 msgr2=0x7f1ccc162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7fcd527fc640 1 --2- 172.21.15.103:0/878827195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd540c5250 0x7fcd5406f2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400f9b0 tx=0x7fcd44032810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a30b3105db686f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f1cd0f55640 1 --2- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc152200 0x7f1ccc162550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f65380cbb10 con 0x7f6538155320 2024-09-19T05:38:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f65380cbdf0 con 0x7f653815ed80 2024-09-19T05:38:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f65377fe640 1 --2- 172.21.15.103:0/3846971050 >> v2:172.21.15.174:3300/0 conn(0x7f6538155320 0x7f65380cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7fb7ccb71640 1 --2- 172.21.15.103:0/1286832084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c000ed90 0x7fb7c0049930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40097a0 tx=0x7fb7c402a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1072fd059967b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f653ce2a640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653815ed80 0x7f65380d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f1cd0f55640 1 -- 172.21.15.103:0/2928960759 >> v1:172.21.15.174:6789/0 conn(0x7f1ccc15b870 legacy=0x7f1ccc151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7fb7bffff640 1 -- 172.21.15.103:0/1286832084 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4037070 con 0x7fb7c000ed90 2024-09-19T05:38:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7fb7bffff640 1 -- 172.21.15.103:0/1286832084 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c402adc0 con 0x7fb7c000ed90 2024-09-19T05:38:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7fb7bffff640 1 -- 172.21.15.103:0/1286832084 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4032660 con 0x7fb7c000ed90 2024-09-19T05:38:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f1cd0f55640 1 -- 172.21.15.103:0/2928960759 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc159f20 con 0x7f1ccc15b490 2024-09-19T05:38:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.618+0000 7f42385c4640 1 -- start start 2024-09-19T05:38:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f42385c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42301596f0 0x7f4230163270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f42385c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42300c7b00 con 0x7f423006f520 2024-09-19T05:38:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f42385c4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42300c7da0 con 0x7f423006f140 2024-09-19T05:38:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f42385c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f42300c8080 con 0x7f42301596f0 2024-09-19T05:38:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f01194cc640 1 -- 172.21.15.103:0/1612039214 >> v1:172.21.15.174:6789/0 conn(0x7f011406be80 legacy=0x7f011406c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f01194cc640 1 -- 172.21.15.103:0/1612039214 >> v1:172.21.15.103:6789/0 conn(0x7f01141610d0 legacy=0x7f01141595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f01194cc640 1 -- 172.21.15.103:0/1612039214 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0114072890 con 0x7f0114070b50 2024-09-19T05:38:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f4235b5f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42301596f0 0x7f4230163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f4236b61640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f423006f520 0x7f4230169b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53426/0 (socket says 172.21.15.103:53426) 2024-09-19T05:38:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7f4236b61640 1 -- 172.21.15.103:0/3997342350 learned_addr learned my addr 172.21.15.103:0/3997342350 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fb7ce374640 1 -- 172.21.15.103:0/1286832084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c000ed90 msgr2=0x7fb7c0049930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fb7ce374640 1 --2- 172.21.15.103:0/1286832084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c000ed90 0x7fb7c0049930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40097a0 tx=0x7fb7c402a0b0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7fcd51ffb640 1 -- 172.21.15.103:0/878827195 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4403e070 con 0x7fcd540c5250 2024-09-19T05:38:10.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f904e6ed640 1 Processor -- start 2024-09-19T05:38:10.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f4235b5f640 1 -- 172.21.15.103:0/3997342350 >> v1:172.21.15.174:6789/0 conn(0x7f423006f140 legacy=0x7f4230158fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:10.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f4235b5f640 1 -- 172.21.15.103:0/3997342350 >> v1:172.21.15.103:6789/0 conn(0x7f423006f520 legacy=0x7f4230169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f4235b5f640 1 -- 172.21.15.103:0/3997342350 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4230162790 con 0x7f42301596f0 2024-09-19T05:38:10.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fb7ce374640 1 -- 172.21.15.103:0/1286832084 shutdown_connections 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fb7ce374640 1 --2- 172.21.15.103:0/1286832084 >> v2:172.21.15.103:3300/0 conn(0x7fb7c004fe40 0x7fb7c0049e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fb7ce374640 1 --2- 172.21.15.103:0/1286832084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c000ed90 0x7fb7c0049930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fb7ce374640 1 -- 172.21.15.103:0/1286832084 >> 172.21.15.103:0/1286832084 conn(0x7fb7c0054470 msgr2=0x7fb7c0054880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f6537fff640 1 -- 172.21.15.103:0/3846971050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653815ed80 msgr2=0x7f65380d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f6537fff640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653815ed80 0x7f65380d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f6537fff640 1 -- 172.21.15.103:0/3846971050 >> v2:172.21.15.174:3300/0 conn(0x7f6538155320 msgr2=0x7f65380cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f6537fff640 1 --2- 172.21.15.103:0/3846971050 >> v2:172.21.15.174:3300/0 conn(0x7f6538155320 0x7f65380cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f6537fff640 1 -- 172.21.15.103:0/3846971050 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65380c5a90 con 0x7f6538154f40 2024-09-19T05:38:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f653ce2a640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653815ed80 0x7f65380d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.619+0000 7fcd51ffb640 1 -- 172.21.15.103:0/878827195 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd44037710 con 0x7fcd540c5250 2024-09-19T05:38:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fcd53fff640 1 -- 172.21.15.103:0/878827195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd540c5250 msgr2=0x7fcd5406f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fcd53fff640 1 --2- 172.21.15.103:0/878827195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd540c5250 0x7fcd5406f2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400f9b0 tx=0x7fcd44032810 comp rx=0 tx=0).stop 2024-09-19T05:38:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fcd53fff640 1 -- 172.21.15.103:0/878827195 shutdown_connections 2024-09-19T05:38:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fcd53fff640 1 --2- 172.21.15.103:0/878827195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd540c5250 0x7fcd5406f2e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f904e6ed640 1 -- start start 2024-09-19T05:38:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fcd53fff640 1 --2- 172.21.15.103:0/878827195 >> v2:172.21.15.103:3300/0 conn(0x7fcd54152960 0x7fcd54073680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7fcd53fff640 1 -- 172.21.15.103:0/878827195 >> 172.21.15.103:0/878827195 conn(0x7fcd5406e7c0 msgr2=0x7fcd5406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.620+0000 7f01194cc640 1 --2- 172.21.15.103:0/1612039214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 0x7f0114160b90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0110009870 tx=0x7f011002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf145f0d48af731 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7fb7ce374640 1 -- 172.21.15.103:0/1286832084 shutdown_connections 2024-09-19T05:38:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f1cd0f55640 1 --2- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc15b490 0x7f1ccc15aa00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b920 tx=0x7f1cbc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b72dfbd37b409ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7fcd53fff640 1 -- 172.21.15.103:0/878827195 shutdown_connections 2024-09-19T05:38:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7fcd53fff640 1 -- 172.21.15.103:0/878827195 wait complete. 2024-09-19T05:38:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f0118ccb640 1 -- 172.21.15.103:0/1612039214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110037070 con 0x7f0114070b50 2024-09-19T05:38:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f0118ccb640 1 -- 172.21.15.103:0/1612039214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0110032440 con 0x7f0114070b50 2024-09-19T05:38:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f0118ccb640 1 -- 172.21.15.103:0/1612039214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100327f0 con 0x7f0114070b50 2024-09-19T05:38:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f1ccb7fe640 1 -- 172.21.15.103:0/2928960759 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc02f710 con 0x7f1ccc15b490 2024-09-19T05:38:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f1ccb7fe640 1 -- 172.21.15.103:0/2928960759 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cbc02f8b0 con 0x7f1ccc15b490 2024-09-19T05:38:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f1ccb7fe640 1 -- 172.21.15.103:0/2928960759 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc02fc80 con 0x7f1ccc15b490 2024-09-19T05:38:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7fb7ce374640 1 -- 172.21.15.103:0/1286832084 wait complete. 2024-09-19T05:38:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f2a66fd6640 1 Processor -- start 2024-09-19T05:38:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f4235b5f640 1 --2- 172.21.15.103:0/3997342350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 0x7f4230163270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f423006cc80 tx=0x7f422002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6225f8d9cd7bf01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f2a66fd6640 1 -- start start 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f1cd31b9640 1 -- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc15b490 msgr2=0x7f1ccc15aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc15b490 0x7f1ccc15aa00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b920 tx=0x7f1cbc02a680 comp rx=0 tx=0).stop 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f1cd31b9640 1 -- 172.21.15.103:0/2928960759 shutdown_connections 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc152200 0x7f1ccc162550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/2928960759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc15b490 0x7f1ccc15aa00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f1cd31b9640 1 -- 172.21.15.103:0/2928960759 >> 172.21.15.103:0/2928960759 conn(0x7f1ccc06cd20 msgr2=0x7f1ccc06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.621+0000 7f6537fff640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6538154f40 0x7f65380c75b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f65380ce270 tx=0x7f652802a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee0ca3c1478e352 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f6536ffd640 1 -- 172.21.15.103:0/3846971050 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528036070 con 0x7f6538154f40 2024-09-19T05:38:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f6536ffd640 1 -- 172.21.15.103:0/3846971050 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6528031600 con 0x7f6538154f40 2024-09-19T05:38:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f6536ffd640 1 -- 172.21.15.103:0/3846971050 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65280319d0 con 0x7f6538154f40 2024-09-19T05:38:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f904e6ed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f904806f140 0x7f9048157880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f011bf31640 1 -- 172.21.15.103:0/1612039214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 msgr2=0x7f0114160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f011bf31640 1 --2- 172.21.15.103:0/1612039214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 0x7f0114160b90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0110009870 tx=0x7f011002a230 comp rx=0 tx=0).stop 2024-09-19T05:38:10.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f9047fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f904806f140 0x7f9048157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f9047fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f904806f140 0x7f9048157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46320/0 (socket says 172.21.15.103:46320) 2024-09-19T05:38:10.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f9047fff640 1 -- 172.21.15.103:0/879273117 learned_addr learned my addr 172.21.15.103:0/879273117 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f011bf31640 1 -- 172.21.15.103:0/1612039214 shutdown_connections 2024-09-19T05:38:10.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7fb7ce374640 1 Processor -- start 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7fb7ce374640 1 -- start start 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f011bf31640 1 --2- 172.21.15.103:0/1612039214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 0x7f0114160b90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.622+0000 7f011bf31640 1 -- 172.21.15.103:0/1612039214 >> 172.21.15.103:0/1612039214 conn(0x7f011406cd20 msgr2=0x7f011406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a66fd6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2a580d8c00 0x7f2a58049810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a66fd6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a58007410 0x7f2a58049d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a66fd6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580de960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a66fd6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2a580d8fe0 con 0x7f2a58007410 2024-09-19T05:38:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a66fd6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5804f7f0 con 0x7f2a580d8c00 2024-09-19T05:38:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a66fd6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2a580e1e90 con 0x7f2a5804f9e0 2024-09-19T05:38:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f423535e640 1 -- 172.21.15.103:0/3997342350 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220037070 con 0x7f42301596f0 2024-09-19T05:38:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f423535e640 1 -- 172.21.15.103:0/3997342350 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4220032440 con 0x7f42301596f0 2024-09-19T05:38:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f423535e640 1 -- 172.21.15.103:0/3997342350 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220032810 con 0x7f42301596f0 2024-09-19T05:38:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904815b3a0 con 0x7f9048158340 2024-09-19T05:38:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9048157dc0 con 0x7f904806f520 2024-09-19T05:38:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f1cd31b9640 1 -- 172.21.15.103:0/2928960759 shutdown_connections 2024-09-19T05:38:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f90480c7cd0 con 0x7f904806f140 2024-09-19T05:38:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f1cd31b9640 1 -- 172.21.15.103:0/2928960759 wait complete. 2024-09-19T05:38:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a5ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a58007410 0x7f2a58049d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a5ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a58007410 0x7f2a58049d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46334/0 (socket says 172.21.15.103:46334) 2024-09-19T05:38:10.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1776670539 learned_addr learned my addr 172.21.15.103:0/1776670539 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f2a64d72640 1 --2- 172.21.15.103:0/1776670539 >> v2:172.21.15.174:3300/0 conn(0x7f2a580d8c00 0x7f2a58049810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6538154f40 msgr2=0x7f65380c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f653e88d640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6538154f40 0x7f65380c75b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f65380ce270 tx=0x7f652802a430 comp rx=0 tx=0).stop 2024-09-19T05:38:10.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1218769969 0 0) 0x7f9048157dc0 con 0x7f904806f520 2024-09-19T05:38:10.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7fcd53fff640 1 Processor -- start 2024-09-19T05:38:10.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7fcd53fff640 1 -- start start 2024-09-19T05:38:10.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f011bf31640 1 -- 172.21.15.103:0/1612039214 shutdown_connections 2024-09-19T05:38:10.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9030003520 con 0x7f904806f520 2024-09-19T05:38:10.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475289068 0 0) 0x7f904815b3a0 con 0x7f9048158340 2024-09-19T05:38:10.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ce374640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c000ed90 0x7fb7c004dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 shutdown_connections 2024-09-19T05:38:10.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f653e88d640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653815ed80 0x7f65380d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f653e88d640 1 --2- 172.21.15.103:0/3846971050 >> v2:172.21.15.174:3300/0 conn(0x7f6538155320 0x7f65380cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f653e88d640 1 --2- 172.21.15.103:0/3846971050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6538154f40 0x7f65380c75b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 >> 172.21.15.103:0/3846971050 conn(0x7f653806bc10 msgr2=0x7f653806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd53fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd5406bc10 0x7fcd540c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd53fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd540c5250 0x7fcd540c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ce374640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c004fe40 0x7fb7c000b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd53fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd54152960 0x7fcd541f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ce374640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c00dcce0 0x7fb7c01847d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9048157dc0 con 0x7f9048158340 2024-09-19T05:38:10.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473680212 0 0) 0x7f9030003520 con 0x7f904806f520 2024-09-19T05:38:10.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 >> v2:172.21.15.103:3300/0 conn(0x7f904806f140 msgr2=0x7f9048157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 --2- 172.21.15.103:0/879273117 >> v2:172.21.15.103:3300/0 conn(0x7f904806f140 0x7f9048157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 >> v1:172.21.15.103:6789/0 conn(0x7f9048158340 legacy=0x7f9048150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90480c7f30 con 0x7f904806f520 2024-09-19T05:38:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f903c001670 con 0x7f904806f520 2024-09-19T05:38:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd53fff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcd540cd380 con 0x7fcd540c5250 2024-09-19T05:38:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ccb71640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c004fe40 0x7fb7c000b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ccb71640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c004fe40 0x7fb7c000b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46772/0 (socket says 172.21.15.103:46772) 2024-09-19T05:38:10.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd53fff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54159330 con 0x7fcd54152960 2024-09-19T05:38:10.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ccb71640 1 -- 172.21.15.103:0/375616575 learned_addr learned my addr 172.21.15.103:0/375616575 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f42385c4640 1 -- 172.21.15.103:0/3997342350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 msgr2=0x7f4230163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f42385c4640 1 --2- 172.21.15.103:0/3997342350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 0x7f4230163270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f423006cc80 tx=0x7f422002a180 comp rx=0 tx=0).stop 2024-09-19T05:38:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd53fff640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcd54152d40 con 0x7fcd5406bc10 2024-09-19T05:38:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd527fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd540c5250 0x7fcd540c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0049190 con 0x7fb7c000ed90 2024-09-19T05:38:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7cdb73640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c00dcce0 0x7fb7c01847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd527fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd540c5250 0x7fcd540c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46360/0 (socket says 172.21.15.103:46360) 2024-09-19T05:38:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd527fc640 1 -- 172.21.15.103:0/1213148582 learned_addr learned my addr 172.21.15.103:0/1213148582 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 >> v1:172.21.15.174:6789/0 conn(0x7f904806f520 legacy=0x7f90480c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300043d0 0x7f9030003930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9030004800 0x7f9030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90300051c0 0x7f90300079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0005ef0 con 0x7fb7c00dcce0 2024-09-19T05:38:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f90480c7cd0 con 0x7f9030004800 2024-09-19T05:38:10.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9030007f60 con 0x7f90300043d0 2024-09-19T05:38:10.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9030008160 con 0x7f90300051c0 2024-09-19T05:38:10.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c0049470 con 0x7fb7c004fe40 2024-09-19T05:38:10.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f2a65573640 1 --2- 172.21.15.103:0/1776670539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd537fe640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd54152960 0x7fcd541f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1776670539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 msgr2=0x7f2a580de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f2a5ffff640 1 --2- 172.21.15.103:0/1776670539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580de960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1776670539 >> v2:172.21.15.174:3300/0 conn(0x7f2a580d8c00 msgr2=0x7f2a58049810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f2a5ffff640 1 --2- 172.21.15.103:0/1776670539 >> v2:172.21.15.174:3300/0 conn(0x7f2a580d8c00 0x7f2a58049810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1776670539 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a580e2170 con 0x7f2a58007410 2024-09-19T05:38:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fb7cd372640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c000ed90 0x7fb7c004dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7fcd52ffd640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd5406bc10 0x7fcd540c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.623+0000 7f011bf31640 1 -- 172.21.15.103:0/1612039214 wait complete. 2024-09-19T05:38:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.624+0000 7f904cc8a640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90300051c0 0x7f90300079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 shutdown_connections 2024-09-19T05:38:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f1cd31b9640 1 Processor -- start 2024-09-19T05:38:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f1cd31b9640 1 -- start start 2024-09-19T05:38:10.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f9047fff640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300043d0 0x7f9030003930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f90477fe640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9030004800 0x7f9030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f653e88d640 1 -- 172.21.15.103:0/3846971050 wait complete. 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7ccb71640 1 -- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c00dcce0 msgr2=0x7fb7c01847d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7ccb71640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c00dcce0 0x7fb7c01847d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7ccb71640 1 -- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c000ed90 msgr2=0x7fb7c004dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7ccb71640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c000ed90 0x7fb7c004dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7ccb71640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c00b5830 con 0x7fb7c004fe40 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7ccb71640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c004fe40 0x7fb7c000b640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40098c0 tx=0x7fb7c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7bdffb640 1 -- 172.21.15.103:0/375616575 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4042020 con 0x7fb7c004fe40 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fb7bdffb640 1 -- 172.21.15.103:0/375616575 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c403d670 con 0x7fb7c004fe40 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c00532f0 con 0x7fb7c004fe40 2024-09-19T05:38:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c004d800 con 0x7fb7c004fe40 2024-09-19T05:38:10.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fcd537fe640 1 -- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd5406bc10 msgr2=0x7fcd540c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fcd537fe640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd5406bc10 0x7fcd540c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fcd537fe640 1 -- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd540c5250 msgr2=0x7fcd540c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fcd537fe640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd540c5250 0x7fcd540c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fcd537fe640 1 -- 172.21.15.103:0/1213148582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd540c8710 con 0x7fcd54152960 2024-09-19T05:38:10.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7fcd537fe640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd54152960 0x7fcd541f02c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c8c0 tx=0x7fcd4c00cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f42385c4640 1 -- 172.21.15.103:0/3997342350 shutdown_connections 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f42385c4640 1 --2- 172.21.15.103:0/3997342350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 0x7f4230163270 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f42385c4640 1 -- 172.21.15.103:0/3997342350 >> 172.21.15.103:0/3997342350 conn(0x7f42300c9230 msgr2=0x7f42300c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f42385c4640 1 -- 172.21.15.103:0/3997342350 shutdown_connections 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f904cc8a640 1 -- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300043d0 msgr2=0x7f9030003930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f904cc8a640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300043d0 0x7f9030003930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f904cc8a640 1 -- 172.21.15.103:0/879273117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9030004800 msgr2=0x7f9030004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f904cc8a640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9030004800 0x7f9030004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f904cc8a640 1 -- 172.21.15.103:0/879273117 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9030003520 con 0x7f90300051c0 2024-09-19T05:38:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f904cc8a640 1 -- 172.21.15.103:0/879273117 reap_dead start 2024-09-19T05:38:10.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f2a5ffff640 1 --2- 172.21.15.103:0/1776670539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a58007410 0x7f2a58049d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a58051820 tx=0x7f2a5402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe20372bf1af5ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f653e88d640 1 Processor -- start 2024-09-19T05:38:10.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f42385c4640 1 -- 172.21.15.103:0/3997342350 wait complete. 2024-09-19T05:38:10.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7fb7bdffb640 1 -- 172.21.15.103:0/375616575 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4042020 con 0x7fb7c004fe40 2024-09-19T05:38:10.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f1cd31b9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc152200 0x7f1ccc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f1cd31b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ccc15b490 0x7f1ccc1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f1cd31b9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc15b870 0x7f1ccc1f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f1cd31b9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc15af40 con 0x7f1ccc15b490 2024-09-19T05:38:10.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f1cd31b9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc15a4e0 con 0x7f1ccc152200 2024-09-19T05:38:10.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f1cd31b9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1ccc070ce0 con 0x7f1ccc15b870 2024-09-19T05:38:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f904cc8a640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90300051c0 0x7f90300079a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9040002010 tx=0x7f9030005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64839ec9e84eb217 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.626+0000 7f2a5f7fe640 1 -- 172.21.15.103:0/1776670539 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54037070 con 0x7f2a58007410 2024-09-19T05:38:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f2a5f7fe640 1 -- 172.21.15.103:0/1776670539 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a54032440 con 0x7f2a58007410 2024-09-19T05:38:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f2a5f7fe640 1 -- 172.21.15.103:0/1776670539 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54032850 con 0x7f2a58007410 2024-09-19T05:38:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f653e88d640 1 -- start start 2024-09-19T05:38:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7fcd3b7fe640 1 -- 172.21.15.103:0/1213148582 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c018070 con 0x7fcd54152960 2024-09-19T05:38:10.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f1ccbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ccc15b490 0x7f1ccc1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f1ccbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ccc15b490 0x7f1ccc1466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46372/0 (socket says 172.21.15.103:46372) 2024-09-19T05:38:10.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f1ccbfff640 1 -- 172.21.15.103:0/3102578820 learned_addr learned my addr 172.21.15.103:0/3102578820 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7fcd53fff640 1 -- 172.21.15.103:0/1213148582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd540c89d0 con 0x7fcd54152960 2024-09-19T05:38:10.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f011bf31640 1 Processor -- start 2024-09-19T05:38:10.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7fcd53fff640 1 -- 172.21.15.103:0/1213148582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd541ef7e0 con 0x7fcd54152960 2024-09-19T05:38:10.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7fcd3b7fe640 1 -- 172.21.15.103:0/1213148582 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00a640 con 0x7fcd54152960 2024-09-19T05:38:10.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040036070 con 0x7f90300051c0 2024-09-19T05:38:10.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9040031600 con 0x7f90300051c0 2024-09-19T05:38:10.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f1cd1756640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc15b870 0x7f1ccc1f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f1cd0f55640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc152200 0x7f1ccc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f42385c4640 1 Processor -- start 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f42385c4640 1 -- start start 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1776670539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a58007410 msgr2=0x7f2a58049d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1776670539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a58007410 0x7f2a58049d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a58051820 tx=0x7f2a5402a1f0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1776670539 shutdown_connections 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1776670539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580de960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1776670539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a58007410 0x7f2a58049d50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1776670539 >> v2:172.21.15.174:3300/0 conn(0x7f2a580d8c00 0x7f2a58049810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1776670539 >> 172.21.15.103:0/1776670539 conn(0x7f2a5800e8b0 msgr2=0x7f2a5800fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f653e88d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6538154f40 0x7f65380cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f9046ffd640 1 -- 172.21.15.103:0/879273117 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040001be0 con 0x7f90300051c0 2024-09-19T05:38:10.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.625+0000 7f011bf31640 1 -- start start 2024-09-19T05:38:10.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f1ccbfff640 1 -- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc15b870 msgr2=0x7f1ccc1f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f011bf31640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f011406be80 0x7f0114156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f011bf31640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 0x7f01141f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f011bf31640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01141610d0 0x7f011414f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f011bf31640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f011406c970 con 0x7f0114070b50 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f011bf31640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0114072e50 con 0x7f011406be80 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f1ccbfff640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc15b870 0x7f1ccc1f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f011bf31640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0114068990 con 0x7f01141610d0 2024-09-19T05:38:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f0119ccd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f011406be80 0x7f0114156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f0119ccd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f011406be80 0x7f0114156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34818/0 (socket says 172.21.15.103:34818) 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f0119ccd640 1 -- 172.21.15.103:0/326130155 learned_addr learned my addr 172.21.15.103:0/326130155 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f0119ccd640 1 -- 172.21.15.103:0/326130155 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01141610d0 msgr2=0x7f011414f620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f1ccbfff640 1 -- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc152200 msgr2=0x7f1ccc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f1ccbfff640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc152200 0x7f1ccc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f0119ccd640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01141610d0 0x7f011414f620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f0119ccd640 1 -- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 msgr2=0x7f01141f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.627+0000 7f0119ccd640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 0x7f01141f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f0119ccd640 1 -- 172.21.15.103:0/326130155 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01141f9890 con 0x7f011406be80 2024-09-19T05:38:10.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f1ccbfff640 1 -- 172.21.15.103:0/3102578820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc151540 con 0x7f1ccc15b490 2024-09-19T05:38:10.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f0119ccd640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f011406be80 0x7f0114156e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c730 tx=0x7f010c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f653e88d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653815ed80 0x7f6538150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f010a7fc640 1 -- 172.21.15.103:0/326130155 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c003b70 con 0x7f011406be80 2024-09-19T05:38:10.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f1ccbfff640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ccc15b490 0x7f1ccc1466a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c7b0 tx=0x7f1cc000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7fcd3b7fe640 1 -- 172.21.15.103:0/1213148582 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00aa30 con 0x7fcd54152960 2024-09-19T05:38:10.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f010a7fc640 1 -- 172.21.15.103:0/326130155 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c003d10 con 0x7f011406be80 2024-09-19T05:38:10.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7f010a7fc640 1 -- 172.21.15.103:0/326130155 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c00aa70 con 0x7f011406be80 2024-09-19T05:38:10.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c00dd0c0 con 0x7fb7c004fe40 2024-09-19T05:38:10.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.628+0000 7fb7bdffb640 1 -- 172.21.15.103:0/375616575 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7c4045020 con 0x7fb7c004fe40 2024-09-19T05:38:10.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01140c45e0 con 0x7f011406be80 2024-09-19T05:38:10.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90300051c0 msgr2=0x7f90300079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f904e6ed640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90300051c0 0x7f90300079a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9040002010 tx=0x7f9030005830 comp rx=0 tx=0).stop 2024-09-19T05:38:10.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f1cd1756640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc15b870 0x7f1ccc1f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:10.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f1cc97fa640 1 -- 172.21.15.103:0/3102578820 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0017070 con 0x7f1ccc15b490 2024-09-19T05:38:10.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f1cc97fa640 1 -- 172.21.15.103:0/3102578820 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc0005270 con 0x7f1ccc15b490 2024-09-19T05:38:10.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ccc1f8930 con 0x7f1ccc15b490 2024-09-19T05:38:10.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ccc1f8ef0 con 0x7f1ccc15b490 2024-09-19T05:38:10.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1776670539 shutdown_connections 2024-09-19T05:38:10.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1776670539 wait complete. 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f653e88d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6538151960 0x7f6538071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f653e88d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f65380d1250 con 0x7f653815ed80 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f653e88d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f65380d10d0 con 0x7f6538151960 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f653e88d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f65380d13d0 con 0x7f6538154f40 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f65377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653815ed80 0x7f6538150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f65377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653815ed80 0x7f6538150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46394/0 (socket says 172.21.15.103:46394) 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f65377fe640 1 -- 172.21.15.103:0/3003377731 learned_addr learned my addr 172.21.15.103:0/3003377731 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f6537fff640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6538154f40 0x7f65380cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7fcd3b7fe640 1 -- 172.21.15.103:0/1213148582 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd4c01b070 con 0x7fcd54152960 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f42385c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f423006f140 0x7f4230072d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f42385c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f423006f520 0x7f4230071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f42385c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 0x7f42300739e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f42385c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f42300c75c0 con 0x7f42301596f0 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f42385c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4230162d50 con 0x7f423006f140 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f4235b5f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f423006f520 0x7f4230071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f4235b5f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f423006f520 0x7f4230071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46798/0 (socket says 172.21.15.103:46798) 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f4235b5f640 1 -- 172.21.15.103:0/538500219 learned_addr learned my addr 172.21.15.103:0/538500219 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f42385c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f42300c7740 con 0x7f423006f520 2024-09-19T05:38:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f4236360640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f423006f140 0x7f4230072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 shutdown_connections 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f904e6ed640 1 --2- 172.21.15.103:0/879273117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90300051c0 0x7f90300079a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 >> 172.21.15.103:0/879273117 conn(0x7f90480c9230 msgr2=0x7f90480c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f4235b5f640 1 -- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f423006f140 msgr2=0x7f4230072d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f4235b5f640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f423006f140 0x7f4230072d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f4235b5f640 1 -- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 msgr2=0x7f42300739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f4235b5f640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 0x7f42300739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f4235b5f640 1 -- 172.21.15.103:0/538500219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42300c5bb0 con 0x7f423006f520 2024-09-19T05:38:10.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7fb7bdffb640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb7ac06c6b0 0x7fb7ac06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7fb7bdffb640 1 -- 172.21.15.103:0/375616575 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb7c403d470 con 0x7fb7c004fe40 2024-09-19T05:38:10.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7fb7cd372640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb7ac06c6b0 0x7fb7ac06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f1cd0f55640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc152200 0x7f1ccc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:10.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f653ce2a640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6538151960 0x7f6538071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 shutdown_connections 2024-09-19T05:38:10.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f904e6ed640 1 -- 172.21.15.103:0/879273117 wait complete. 2024-09-19T05:38:10.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7fcd53fff640 1 -- 172.21.15.103:0/1213148582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd34005290 con 0x7fcd54152960 2024-09-19T05:38:10.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.629+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01141f8db0 con 0x7f011406be80 2024-09-19T05:38:10.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f1cc97fa640 1 -- 172.21.15.103:0/3102578820 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000a640 con 0x7f1ccc15b490 2024-09-19T05:38:10.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f4235b5f640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f423006f520 0x7f4230071810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4220009860 tx=0x7f42200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f00f7fff640 1 -- 172.21.15.103:0/326130155 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f0005290 con 0x7f011406be80 2024-09-19T05:38:10.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7fb7cd372640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb7ac06c6b0 0x7fb7ac06eb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800c7f0 tx=0x7fb7b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f6537fff640 1 -- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6538151960 msgr2=0x7f6538071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f6537fff640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6538151960 0x7f6538071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f6537fff640 1 -- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653815ed80 msgr2=0x7f6538150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f6537fff640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653815ed80 0x7f6538150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f6537fff640 1 -- 172.21.15.103:0/3003377731 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65381f4a80 con 0x7f6538154f40 2024-09-19T05:38:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.630+0000 7f65377fe640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653815ed80 0x7f6538150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.631+0000 7fcd3b7fe640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcd4006c380 0x7fcd4006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.631+0000 7f2a66fd6640 1 Processor -- start 2024-09-19T05:38:10.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.631+0000 7f6537fff640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6538154f40 0x7f65380cf9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f653806c850 tx=0x7f65280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.631+0000 7fcd3b7fe640 1 -- 172.21.15.103:0/1213148582 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcd4c08af10 con 0x7fcd54152960 2024-09-19T05:38:10.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.631+0000 7fcd52ffd640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcd4006c380 0x7fcd4006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.631+0000 7f2a66fd6640 1 -- start start 2024-09-19T05:38:10.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.631+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ccc157340 con 0x7f1ccc15b490 2024-09-19T05:38:10.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f010a7fc640 1 -- 172.21.15.103:0/326130155 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f010c00ac10 con 0x7f011406be80 2024-09-19T05:38:10.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7fcd52ffd640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcd4006c380 0x7fcd4006e840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800b810 tx=0x7fcd48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f2a66fd6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58007410 0x7f2a58050a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f904e6ed640 1 Processor -- start 2024-09-19T05:38:10.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f2a66fd6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580db8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f2a66fd6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a580d8c00 0x7f2a58178de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f1cc97fa640 1 -- 172.21.15.103:0/3102578820 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1cc001a070 con 0x7f1ccc15b490 2024-09-19T05:38:10.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f2a66fd6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2a580e2a10 con 0x7f2a580d8c00 2024-09-19T05:38:10.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f2a66fd6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2a580e2730 con 0x7f2a58007410 2024-09-19T05:38:10.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f2a66fd6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5804f490 con 0x7f2a5804f9e0 2024-09-19T05:38:10.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580db8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.632+0000 7f904e6ed640 1 -- start start 2024-09-19T05:38:10.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f010a7fc640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f00f806c2b0 0x7f00f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580db8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:46810/0 (socket says 172.21.15.103:46810) 2024-09-19T05:38:10.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1597426768 learned_addr learned my addr 172.21.15.103:0/1597426768 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a64d72640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58007410 0x7f2a58050a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a65573640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a580d8c00 0x7f2a58178de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f010a7fc640 1 -- 172.21.15.103:0/326130155 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f010c08b6c0 con 0x7f011406be80 2024-09-19T05:38:10.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f01194cc640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f00f806c2b0 0x7f00f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f1cc97fa640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1cb806c300 0x7f1cb806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58007410 msgr2=0x7f2a58050a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58007410 0x7f2a58050a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a580d8c00 msgr2=0x7f2a58178de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a580d8c00 0x7f2a58178de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 -- 172.21.15.103:0/1597426768 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5817cab0 con 0x7f2a5804f9e0 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a64d72640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58007410 0x7f2a58050a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f1cc97fa640 1 -- 172.21.15.103:0/3102578820 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1cc008b230 con 0x7f1ccc15b490 2024-09-19T05:38:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f1cd0f55640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1cb806c300 0x7f1cb806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f2a5ffff640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580db8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009960 tx=0x7f2a540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.633+0000 7f01194cc640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f00f806c2b0 0x7f00f806e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0110034000 tx=0x7f011002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f904e6ed640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300051c0 0x7f90481ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f904e6ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90480cc7a0 0x7f90481ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f904e6ed640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90481efe10 0x7f904814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f1cd0f55640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1cb806c300 0x7f1cb806e7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc034000 tx=0x7f1cbc02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f904e6ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f904815aba0 con 0x7f90480cc7a0 2024-09-19T05:38:10.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f904e6ed640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f904815a8c0 con 0x7f90300051c0 2024-09-19T05:38:10.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300051c0 0x7f90481ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f904e6ed640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f904815ae80 con 0x7f90481efe10 2024-09-19T05:38:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300051c0 0x7f90481ec8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:34852/0 (socket says 172.21.15.103:34852) 2024-09-19T05:38:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 -- 172.21.15.103:0/3026540129 learned_addr learned my addr 172.21.15.103:0/3026540129 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f90477fe640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90480cc7a0 0x7f90481ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f904cc8a640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90481efe10 0x7f904814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f2a5d7fa640 1 -- 172.21.15.103:0/1597426768 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54041020 con 0x7f2a5804f9e0 2024-09-19T05:38:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f4226ffd640 1 -- 172.21.15.103:0/538500219 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220037040 con 0x7f423006f520 2024-09-19T05:38:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423015b910 con 0x7f423006f520 2024-09-19T05:38:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7fb7bdffb640 1 -- 172.21.15.103:0/375616575 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb7c404c030 con 0x7fb7c004fe40 2024-09-19T05:38:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f2a5d7fa640 1 -- 172.21.15.103:0/1597426768 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a54030780 con 0x7f2a5804f9e0 2024-09-19T05:38:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f2a5d7fa640 1 -- 172.21.15.103:0/1597426768 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54037040 con 0x7f2a5804f9e0 2024-09-19T05:38:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f6534ff9640 1 -- 172.21.15.103:0/3003377731 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528040020 con 0x7f6538154f40 2024-09-19T05:38:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f6534ff9640 1 -- 172.21.15.103:0/3003377731 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652803b670 con 0x7f6538154f40 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f6534ff9640 1 -- 172.21.15.103:0/3003377731 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528036040 con 0x7f6538154f40 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4230072560 con 0x7f423006f520 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f4226ffd640 1 -- 172.21.15.103:0/538500219 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4220004230 con 0x7f423006f520 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f4226ffd640 1 -- 172.21.15.103:0/538500219 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220030720 con 0x7f423006f520 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 -- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90481efe10 msgr2=0x7f904814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90481efe10 0x7f904814bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 -- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90480cc7a0 msgr2=0x7f90481ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90480cc7a0 0x7f90481ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:10.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.634+0000 7f9047fff640 1 -- 172.21.15.103:0/3026540129 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90481f0290 con 0x7f90300051c0 2024-09-19T05:38:10.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.635+0000 7f9047fff640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300051c0 0x7f90481ec8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90380108c0 tx=0x7f9038010d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.635+0000 7f904cc8a640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90481efe10 0x7f904814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:10.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.635+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a580cf520 con 0x7f2a5804f9e0 2024-09-19T05:38:10.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.635+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a580ceba0 con 0x7f2a5804f9e0 2024-09-19T05:38:10.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.635+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653815de40 con 0x7f6538154f40 2024-09-19T05:38:10.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.636+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65381f5000 con 0x7f6538154f40 2024-09-19T05:38:10.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.636+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4218005290 con 0x7f423006f520 2024-09-19T05:38:10.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.636+0000 7fcd3b7fe640 1 -- 172.21.15.103:0/1213148582 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcd4c058cd0 con 0x7fcd54152960 2024-09-19T05:38:10.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.636+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5804f1c0 con 0x7f2a5804f9e0 2024-09-19T05:38:10.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.636+0000 7f4226ffd640 1 -- 172.21.15.103:0/538500219 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42200308c0 con 0x7f423006f520 2024-09-19T05:38:10.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.637+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65380cc910 con 0x7f6538154f40 2024-09-19T05:38:10.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.637+0000 7f4226ffd640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f421406c2b0 0x7f421406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.637+0000 7f4226ffd640 1 -- 172.21.15.103:0/538500219 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f42200ac940 con 0x7f423006f520 2024-09-19T05:38:10.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.637+0000 7f4236360640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f421406c2b0 0x7f421406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.637+0000 7f2a5d7fa640 1 -- 172.21.15.103:0/1597426768 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2a54044020 con 0x7f2a5804f9e0 2024-09-19T05:38:10.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f6534ff9640 1 -- 172.21.15.103:0/3003377731 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6528043020 con 0x7f6538154f40 2024-09-19T05:38:10.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f4236360640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f421406c2b0 0x7f421406e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4228007bf0 tx=0x7f4228007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f2a5d7fa640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f2a4406c2b0 0x7f2a4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f6534ff9640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652406c3b0 0x7f652406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f2a64d72640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f2a4406c2b0 0x7f2a4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f6534ff9640 1 -- 172.21.15.103:0/3003377731 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f65280abb30 con 0x7f6538154f40 2024-09-19T05:38:10.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f65377fe640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652406c3b0 0x7f652406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.638+0000 7f2a5d7fa640 1 -- 172.21.15.103:0/1597426768 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2a540ac090 con 0x7f2a5804f9e0 2024-09-19T05:38:10.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.639+0000 7f2a64d72640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f2a4406c2b0 0x7f2a4406e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007d10 tx=0x7f2a4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.639+0000 7f65377fe640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652406c3b0 0x7f652406e870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f653815ba90 tx=0x7f652c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.639+0000 7f1cc97fa640 1 -- 172.21.15.103:0/3102578820 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1ccc157340 con 0x7f1ccc15b490 2024-09-19T05:38:10.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.640+0000 7f9044ff9640 1 -- 172.21.15.103:0/3026540129 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903801a070 con 0x7f90300051c0 2024-09-19T05:38:10.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.640+0000 7f9044ff9640 1 -- 172.21.15.103:0/3026540129 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903800e960 con 0x7f90300051c0 2024-09-19T05:38:10.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.640+0000 7f904e6ed640 1 -- 172.21.15.103:0/3026540129 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90481517b0 con 0x7f90300051c0 2024-09-19T05:38:10.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.640+0000 7f010a7fc640 1 -- 172.21.15.103:0/326130155 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f010c059ae0 con 0x7f011406be80 2024-09-19T05:38:10.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.642+0000 7f9044ff9640 1 -- 172.21.15.103:0/3026540129 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903800ed10 con 0x7f90300051c0 2024-09-19T05:38:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.642+0000 7f904e6ed640 1 -- 172.21.15.103:0/3026540129 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9048151a50 con 0x7f90300051c0 2024-09-19T05:38:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.643+0000 7f4226ffd640 1 -- 172.21.15.103:0/538500219 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f422007ad60 con 0x7f423006f520 2024-09-19T05:38:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.643+0000 7f9044ff9640 1 -- 172.21.15.103:0/3026540129 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f903801d070 con 0x7f90300051c0 2024-09-19T05:38:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.644+0000 7f9044ff9640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f903406c300 0x7f903406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.644+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9048072560 con 0x7f90300051c0 2024-09-19T05:38:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.644+0000 7f90477fe640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f903406c300 0x7f903406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.644+0000 7f9044ff9640 1 -- 172.21.15.103:0/3026540129 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f903808b070 con 0x7f90300051c0 2024-09-19T05:38:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.645+0000 7f90477fe640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f903406c300 0x7f903406e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90480c5010 tx=0x7f903c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.646+0000 7f2a5d7fa640 1 -- 172.21.15.103:0/1597426768 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2a5804f1c0 con 0x7f2a5804f9e0 2024-09-19T05:38:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.649+0000 7f9044ff9640 1 -- 172.21.15.103:0/3026540129 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f90481f0290 con 0x7f90300051c0 2024-09-19T05:38:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:10.650+0000 7f6534ff9640 1 -- 172.21.15.103:0/3003377731 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f65380cc910 con 0x7f6538154f40 2024-09-19T05:38:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.036+0000 7fcd53fff640 1 -- 172.21.15.103:0/1213148582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcd34005580 con 0x7fcd54152960 2024-09-19T05:38:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.037+0000 7fcd3b7fe640 1 -- 172.21.15.103:0/1213148582 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd4c05cfd0 con 0x7fcd54152960 2024-09-19T05:38:11.039 INFO:teuthology.orchestra.run.smithi103.stdout:60129542153 2024-09-19T05:38:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.037+0000 7f00f7fff640 1 -- 172.21.15.103:0/326130155 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f00f0005580 con 0x7f011406be80 2024-09-19T05:38:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.038+0000 7f010a7fc640 1 -- 172.21.15.103:0/326130155 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f010c0593e0 con 0x7f011406be80 2024-09-19T05:38:11.039 INFO:teuthology.orchestra.run.smithi103.stdout:60129542153 2024-09-19T05:38:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.040+0000 7fcd397fa640 1 -- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcd4006c380 msgr2=0x7fcd4006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcd4006c380 0x7fcd4006e840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800b810 tx=0x7fcd48008040 comp rx=0 tx=0).stop 2024-09-19T05:38:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 -- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd54152960 msgr2=0x7fcd541f02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd54152960 0x7fcd541f02c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c8c0 tx=0x7fcd4c00cd80 comp rx=0 tx=0).stop 2024-09-19T05:38:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f00f806c2b0 msgr2=0x7f00f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7f011bf31640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f00f806c2b0 0x7f00f806e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0110034000 tx=0x7f011002c000 comp rx=0 tx=0).stop 2024-09-19T05:38:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 -- 172.21.15.103:0/1213148582 shutdown_connections 2024-09-19T05:38:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f011406be80 msgr2=0x7f0114156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcd4006c380 0x7fcd4006e840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd54152960 0x7fcd541f02c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd540c5250 0x7fcd540c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.041+0000 7fcd397fa640 1 --2- 172.21.15.103:0/1213148582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd5406bc10 0x7fcd540c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7fcd397fa640 1 -- 172.21.15.103:0/1213148582 >> 172.21.15.103:0/1213148582 conn(0x7fcd5406e7c0 msgr2=0x7fcd5406d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f011406be80 0x7f0114156e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c730 tx=0x7f010c00cbf0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7fcd397fa640 1 -- 172.21.15.103:0/1213148582 shutdown_connections 2024-09-19T05:38:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7fcd397fa640 1 -- 172.21.15.103:0/1213148582 wait complete. 2024-09-19T05:38:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 shutdown_connections 2024-09-19T05:38:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f00f806c2b0 0x7f00f806e770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01141610d0 0x7f011414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0114070b50 0x7f01141f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 --2- 172.21.15.103:0/326130155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f011406be80 0x7f0114156e00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 >> 172.21.15.103:0/326130155 conn(0x7f011406cd20 msgr2=0x7f01140ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 shutdown_connections 2024-09-19T05:38:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.042+0000 7f011bf31640 1 -- 172.21.15.103:0/326130155 wait complete. 2024-09-19T05:38:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.044+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ccc0746d0 con 0x7f1ccc15b490 2024-09-19T05:38:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.045+0000 7f1cc97fa640 1 -- 172.21.15.103:0/3102578820 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1cc00590f0 con 0x7f1ccc15b490 2024-09-19T05:38:11.048 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-09-19T05:38:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.045+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2a58049380 con 0x7f2a5804f9e0 2024-09-19T05:38:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.046+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb7c0053b90 con 0x7fb7c004fe40 2024-09-19T05:38:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.046+0000 7f2a5d7fa640 1 -- 172.21.15.103:0/1597426768 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2a5804f1c0 con 0x7f2a5804f9e0 2024-09-19T05:38:11.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.047+0000 7fb7bdffb640 1 -- 172.21.15.103:0/375616575 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7c00532f0 con 0x7fb7c004fe40 2024-09-19T05:38:11.049 INFO:teuthology.orchestra.run.smithi103.stdout:60129542153 2024-09-19T05:38:11.049 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.048+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1cb806c300 msgr2=0x7f1cb806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.048+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1cb806c300 0x7f1cb806e7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc034000 tx=0x7f1cbc02f000 comp rx=0 tx=0).stop 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.048+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ccc15b490 msgr2=0x7f1ccc1466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.048+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ccc15b490 0x7f1ccc1466a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c7b0 tx=0x7f1cc000cc70 comp rx=0 tx=0).stop 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.049+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 shutdown_connections 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.049+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1cb806c300 0x7f1cb806e7c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.049+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ccc15b870 0x7f1ccc1f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.049+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ccc15b490 0x7f1ccc1466a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.049+0000 7f1cd31b9640 1 --2- 172.21.15.103:0/3102578820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ccc152200 0x7f1ccc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.049+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 >> 172.21.15.103:0/3102578820 conn(0x7f1ccc06cd20 msgr2=0x7f1ccc156130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 shutdown_connections 2024-09-19T05:38:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7f1cd31b9640 1 -- 172.21.15.103:0/3102578820 wait complete. 2024-09-19T05:38:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb7ac06c6b0 msgr2=0x7fb7ac06eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f2a4406c2b0 msgr2=0x7f2a4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f2a4406c2b0 0x7f2a4406e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007d10 tx=0x7f2a4c008040 comp rx=0 tx=0).stop 2024-09-19T05:38:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7fb7ce374640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb7ac06c6b0 0x7fb7ac06eb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800c7f0 tx=0x7fb7b8009040 comp rx=0 tx=0).stop 2024-09-19T05:38:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 msgr2=0x7f2a580db8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.050+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580db8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009960 tx=0x7f2a540046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 shutdown_connections 2024-09-19T05:38:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c004fe40 msgr2=0x7fb7c000b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c004fe40 0x7fb7c000b640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40098c0 tx=0x7fb7c40046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f2a4406c2b0 0x7f2a4406e770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a580d8c00 0x7f2a58178de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5804f9e0 0x7f2a580db8b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 --2- 172.21.15.103:0/1597426768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58007410 0x7f2a58050a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 >> 172.21.15.103:0/1597426768 conn(0x7f2a5800e8b0 msgr2=0x7f2a58037d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 shutdown_connections 2024-09-19T05:38:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7f2a66fd6640 1 -- 172.21.15.103:0/1597426768 wait complete. 2024-09-19T05:38:11.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 shutdown_connections 2024-09-19T05:38:11.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb7ac06c6b0 0x7fb7ac06eb70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c00dcce0 0x7fb7c01847d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7c004fe40 0x7fb7c000b640 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 --2- 172.21.15.103:0/375616575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7c000ed90 0x7fb7c004dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.051+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 >> 172.21.15.103:0/375616575 conn(0x7fb7c0054470 msgr2=0x7fb7c00dc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.052+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 shutdown_connections 2024-09-19T05:38:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.052+0000 7fb7ce374640 1 -- 172.21.15.103:0/375616575 wait complete. 2024-09-19T05:38:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.052+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4218005580 con 0x7f423006f520 2024-09-19T05:38:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.053+0000 7f4226ffd640 1 -- 172.21.15.103:0/538500219 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f422007a660 con 0x7f423006f520 2024-09-19T05:38:11.058 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-09-19T05:38:11.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f65380cda60 con 0x7f6538154f40 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f421406c2b0 msgr2=0x7f421406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f421406c2b0 0x7f421406e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4228007bf0 tx=0x7f4228007240 comp rx=0 tx=0).stop 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f423006f520 msgr2=0x7f4230071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f423006f520 0x7f4230071810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4220009860 tx=0x7f42200046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 shutdown_connections 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f421406c2b0 0x7f421406e770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42301596f0 0x7f42300739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f423006f520 0x7f4230071810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 --2- 172.21.15.103:0/538500219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f423006f140 0x7f4230072d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 >> 172.21.15.103:0/538500219 conn(0x7f42300c9230 msgr2=0x7f4230160ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 shutdown_connections 2024-09-19T05:38:11.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.057+0000 7f42385c4640 1 -- 172.21.15.103:0/538500219 wait complete. 2024-09-19T05:38:11.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.058+0000 7f6534ff9640 1 -- 172.21.15.103:0/3003377731 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65380cda60 con 0x7f6538154f40 2024-09-19T05:38:11.060 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:11.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.060+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f90480c71a0 con 0x7f90300051c0 2024-09-19T05:38:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.062+0000 7f9044ff9640 1 -- 172.21.15.103:0/3026540129 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9038058ed0 con 0x7f90300051c0 2024-09-19T05:38:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.062+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652406c3b0 msgr2=0x7f652406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.062+0000 7f653e88d640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652406c3b0 0x7f652406e870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f653815ba90 tx=0x7f652c008040 comp rx=0 tx=0).stop 2024-09-19T05:38:11.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.062+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6538154f40 msgr2=0x7f65380cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.062+0000 7f653e88d640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6538154f40 0x7f65380cf9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f653806c850 tx=0x7f65280046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.063+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 shutdown_connections 2024-09-19T05:38:11.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.063+0000 7f653e88d640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652406c3b0 0x7f652406e870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.063+0000 7f653e88d640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6538151960 0x7f6538071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.063+0000 7f653e88d640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653815ed80 0x7f6538150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.063+0000 7f653e88d640 1 --2- 172.21.15.103:0/3003377731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6538154f40 0x7f65380cf9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.063+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 >> 172.21.15.103:0/3003377731 conn(0x7f653806bc10 msgr2=0x7f65380c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.066 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:11.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-09-19T05:38:11.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.7 2024-09-19T05:38:11.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.064+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 shutdown_connections 2024-09-19T05:38:11.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.064+0000 7f653e88d640 1 -- 172.21.15.103:0/3003377731 wait complete. 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f903406c300 msgr2=0x7f903406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f903406c300 0x7f903406e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90480c5010 tx=0x7f903c009040 comp rx=0 tx=0).stop 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300051c0 msgr2=0x7f90481ec8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300051c0 0x7f90481ec8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90380108c0 tx=0x7f9038010d80 comp rx=0 tx=0).stop 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 shutdown_connections 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f903406c300 0x7f903406e7c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90481efe10 0x7f904814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90480cc7a0 0x7f90481ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 --2- 172.21.15.103:0/3026540129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90300051c0 0x7f90481ec8e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.065+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 >> 172.21.15.103:0/3026540129 conn(0x7f90480c9230 msgr2=0x7f904814f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.066+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 shutdown_connections 2024-09-19T05:38:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:11.066+0000 7f902e7fc640 1 -- 172.21.15.103:0/3026540129 wait complete. 2024-09-19T05:38:11.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-09-19T05:38:11.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.2 2024-09-19T05:38:11.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.0 2024-09-19T05:38:11.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.1 2024-09-19T05:38:11.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2024-09-19T05:38:11.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.4 2024-09-19T05:38:12.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T05:38:12.069 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T05:38:12.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T05:38:12.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T05:38:12.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T05:38:12.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T05:38:12.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T05:38:12.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T05:38:12.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:12.212 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:12.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.220+0000 7f66579fd640 1 Processor -- start 2024-09-19T05:38:12.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.220+0000 7f66579fd640 1 -- start start 2024-09-19T05:38:12.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f66579fd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66500c9710 0x7f66500c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f66579fd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665015b0f0 0x7f6650156e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f66579fd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66500c9af0 0x7f6650157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f66579fd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f665015a3c0 con 0x7f66500c9710 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f66579fd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f6650157930 con 0x7f66500c9af0 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f66579fd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6650157c10 con 0x7f665015b0f0 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f6655f9a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66500c9af0 0x7f6650157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f6655f9a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66500c9af0 0x7f6650157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:50916/0 (socket says 172.21.15.103:50916) 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7f6655f9a640 1 -- 172.21.15.103:0/361254827 learned_addr learned my addr 172.21.15.103:0/361254827 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7f6655f9a640 1 -- 172.21.15.103:0/361254827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665015b0f0 msgr2=0x7f6650156e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7f6655f9a640 1 --2- 172.21.15.103:0/361254827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665015b0f0 0x7f6650156e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7f6655f9a640 1 -- 172.21.15.103:0/361254827 >> v2:172.21.15.103:3300/0 conn(0x7f66500c9710 msgr2=0x7f66500c7d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:12.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7f6655799640 1 --2- 172.21.15.103:0/361254827 >> v2:172.21.15.103:3300/0 conn(0x7f66500c9710 0x7f66500c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7f6655f9a640 1 --2- 172.21.15.103:0/361254827 >> v2:172.21.15.103:3300/0 conn(0x7f66500c9710 0x7f66500c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7f6655f9a640 1 -- 172.21.15.103:0/361254827 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665015a610 con 0x7f66500c9af0 2024-09-19T05:38:12.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.225+0000 7f6655799640 1 --2- 172.21.15.103:0/361254827 >> v2:172.21.15.103:3300/0 conn(0x7f66500c9710 0x7f66500c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:12.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.225+0000 7f6655f9a640 1 --2- 172.21.15.103:0/361254827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66500c9af0 0x7f6650157350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66500c3160 tx=0x7f664802cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c936887b11c3b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.217+0000 7fc2ddc5c640 1 Processor -- start 2024-09-19T05:38:12.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.217+0000 7fc2ddc5c640 1 -- start start 2024-09-19T05:38:12.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.218+0000 7fc2ddc5c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.218+0000 7fc2ddc5c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d000f670 0x7fc2d004e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.218+0000 7fc2ddc5c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d00e39e0 con 0x7fc2d004ef20 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.218+0000 7fc2ddc5c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d004fea0 con 0x7fc2d000f670 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.218+0000 7fc2ddc5c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d0050840 con 0x7fc2d00dcd10 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.219+0000 7fc2d7fff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc2d004ef20 0x7fc2d000e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:60576/0 (socket says 172.21.15.103:60576) 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.219+0000 7fc2d7fff640 1 -- 172.21.15.103:0/90312898 learned_addr learned my addr 172.21.15.103:0/90312898 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.219+0000 7fc2d6ffd640 1 --2- 172.21.15.103:0/90312898 >> v2:172.21.15.103:3300/0 conn(0x7fc2d000f670 0x7fc2d004e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.219+0000 7fc2d6ffd640 1 -- 172.21.15.103:0/90312898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 msgr2=0x7fc2d00e6a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.219+0000 7fc2d6ffd640 1 --2- 172.21.15.103:0/90312898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00e6a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.219+0000 7fc2d6ffd640 1 -- 172.21.15.103:0/90312898 >> v1:172.21.15.174:6789/0 conn(0x7fc2d004ef20 legacy=0x7fc2d000e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.219+0000 7fc2d6ffd640 1 -- 172.21.15.103:0/90312898 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d0050580 con 0x7fc2d000f670 2024-09-19T05:38:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.221+0000 7fc2d6ffd640 1 --2- 172.21.15.103:0/90312898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d004e9e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009a30 tx=0x7fc2cc02a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d815e069282c4923 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.221+0000 7fc2d67fc640 1 -- 172.21.15.103:0/90312898 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc037070 con 0x7fc2d000f670 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.221+0000 7fc2d67fc640 1 -- 172.21.15.103:0/90312898 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc02ae30 con 0x7fc2d000f670 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/90312898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 msgr2=0x7fc2d004e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/90312898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d004e9e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009a30 tx=0x7fc2cc02a3b0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/90312898 shutdown_connections 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/90312898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d004e9e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/90312898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.222+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/90312898 >> 172.21.15.103:0/90312898 conn(0x7fc2d0054450 msgr2=0x7fc2d0054860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/90312898 shutdown_connections 2024-09-19T05:38:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.223+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/90312898 wait complete. 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.224+0000 7fc2ddc5c640 1 Processor -- start 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.225+0000 7fc2ddc5c640 1 -- start start 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2ddc5c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d00b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2ddc5c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d004ef20 0x7fc2d0053100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2ddc5c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2ddc5c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d00e31e0 con 0x7fc2d000f670 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2ddc5c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d00e2f00 con 0x7fc2d004ef20 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2ddc5c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d00e34c0 con 0x7fc2d00dcd10 2024-09-19T05:38:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2d7fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2d7fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00dbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60680/0 (socket says 172.21.15.103:60680) 2024-09-19T05:38:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.226+0000 7fc2d7fff640 1 -- 172.21.15.103:0/2531106828 learned_addr learned my addr 172.21.15.103:0/2531106828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.227+0000 7fc2d77fe640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d00b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.227+0000 7fc2d7fff640 1 -- 172.21.15.103:0/2531106828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d004ef20 msgr2=0x7fc2d0053100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7f6647fff640 1 -- 172.21.15.103:0/361254827 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664802d820 con 0x7f66500c9af0 2024-09-19T05:38:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7f6647fff640 1 -- 172.21.15.103:0/361254827 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664802d9c0 con 0x7f66500c9af0 2024-09-19T05:38:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.227+0000 7fc2d7fff640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d004ef20 0x7fc2d0053100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 -- 172.21.15.103:0/361254827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66500c9af0 msgr2=0x7f6650157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 --2- 172.21.15.103:0/361254827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66500c9af0 0x7f6650157350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66500c3160 tx=0x7f664802cce0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 -- 172.21.15.103:0/361254827 shutdown_connections 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 --2- 172.21.15.103:0/361254827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66500c9af0 0x7f6650157350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 --2- 172.21.15.103:0/361254827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665015b0f0 0x7f6650156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 --2- 172.21.15.103:0/361254827 >> v2:172.21.15.103:3300/0 conn(0x7f66500c9710 0x7f66500c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 -- 172.21.15.103:0/361254827 >> 172.21.15.103:0/361254827 conn(0x7f66500cc730 msgr2=0x7f66500ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 -- 172.21.15.103:0/361254827 shutdown_connections 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.229+0000 7f66579fd640 1 -- 172.21.15.103:0/361254827 wait complete. 2024-09-19T05:38:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.231+0000 7f66579fd640 1 Processor -- start 2024-09-19T05:38:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.227+0000 7fc2d7fff640 1 -- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 msgr2=0x7fc2d00b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.227+0000 7fc2d7fff640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d00b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.227+0000 7fc2d7fff640 1 -- 172.21.15.103:0/2531106828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d00b8260 con 0x7fc2d00dcd10 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.227+0000 7fc2d77fe640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d00b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7fc2d7fff640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00dbd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80504d0 tx=0x7fc2d80505e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7fc2c3fff640 1 -- 172.21.15.103:0/2531106828 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80773f0 con 0x7fc2d00dcd10 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7fc2c3fff640 1 -- 172.21.15.103:0/2531106828 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d8092020 con 0x7fc2d00dcd10 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7fc2c3fff640 1 -- 172.21.15.103:0/2531106828 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80743c0 con 0x7fc2d00dcd10 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d00b6940 con 0x7fc2d00dcd10 2024-09-19T05:38:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.228+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d00b6f00 con 0x7fc2d00dcd10 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.231+0000 7fc2c3fff640 1 -- 172.21.15.103:0/2531106828 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc2d8074560 con 0x7fc2d00dcd10 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.231+0000 7fc2c1ffb640 1 -- 172.21.15.103:0/2531106828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d00dd0f0 con 0x7fc2d00dcd10 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.232+0000 7fc2c3fff640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc2bc06c300 0x7fc2bc06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.232+0000 7fc2c3fff640 1 -- 172.21.15.103:0/2531106828 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc2d8107bb0 con 0x7fc2d00dcd10 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.233+0000 7fc2d77fe640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc2bc06c300 0x7fc2bc06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.233+0000 7fc2d77fe640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc2bc06c300 0x7fc2bc06e7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009d50 tx=0x7fc2c4009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.237+0000 7fc2c3fff640 1 -- 172.21.15.103:0/2531106828 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc2d809c030 con 0x7fc2d00dcd10 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.237+0000 7f66579fd640 1 -- start start 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f66579fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66500c9710 0x7f6650154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f66579fd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66500c9af0 0x7f665014c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f66579fd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665015b0f0 0x7f665014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f66579fd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66500c8250 con 0x7f66500c9710 2024-09-19T05:38:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f66579fd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f665015abd0 con 0x7f665015b0f0 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f66579fd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f66500c9050 con 0x7f66500c9af0 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f6655f9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665015b0f0 0x7f665014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f6655f9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665015b0f0 0x7f665014b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:50936/0 (socket says 172.21.15.103:50936) 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f6655f9a640 1 -- 172.21.15.103:0/3469831404 learned_addr learned my addr 172.21.15.103:0/3469831404 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.239+0000 7f6654f98640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66500c9af0 0x7f665014c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.240+0000 7f6655f9a640 1 -- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66500c9af0 msgr2=0x7f665014c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.240+0000 7f6655f9a640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66500c9af0 0x7f665014c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.240+0000 7f6655f9a640 1 -- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66500c9710 msgr2=0x7f6650154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.240+0000 7f6655f9a640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66500c9710 0x7f6650154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.240+0000 7f6655f9a640 1 -- 172.21.15.103:0/3469831404 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66501560d0 con 0x7f665015b0f0 2024-09-19T05:38:12.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.240+0000 7f6655f9a640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665015b0f0 0x7f665014b3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6648009c90 tx=0x7f6648004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.240+0000 7f6645ffb640 1 -- 172.21.15.103:0/3469831404 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648004240 con 0x7f665015b0f0 2024-09-19T05:38:12.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.241+0000 7f66579fd640 1 -- 172.21.15.103:0/3469831404 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6650156390 con 0x7f665015b0f0 2024-09-19T05:38:12.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.241+0000 7f66579fd640 1 -- 172.21.15.103:0/3469831404 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665014abf0 con 0x7f665015b0f0 2024-09-19T05:38:12.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.242+0000 7f6645ffb640 1 -- 172.21.15.103:0/3469831404 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6648044070 con 0x7f665015b0f0 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.244+0000 7f6645ffb640 1 -- 172.21.15.103:0/3469831404 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648004600 con 0x7f665015b0f0 2024-09-19T05:38:12.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.244+0000 7f6645ffb640 1 -- 172.21.15.103:0/3469831404 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f664802d9c0 con 0x7f665015b0f0 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.245+0000 7f6645ffb640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f663406c3b0 0x7f663406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.245+0000 7f6645ffb640 1 -- 172.21.15.103:0/3469831404 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f66480acb00 con 0x7f665015b0f0 2024-09-19T05:38:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.245+0000 7f6655799640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f663406c3b0 0x7f663406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.251+0000 7f6655799640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f663406c3b0 0x7f663406e870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f664000a8b0 tx=0x7f6640008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.251+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6630005290 con 0x7f665015b0f0 2024-09-19T05:38:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.261+0000 7f6645ffb640 1 -- 172.21.15.103:0/3469831404 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f664807af10 con 0x7f665015b0f0 2024-09-19T05:38:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.280+0000 7f6543650640 1 Processor -- start 2024-09-19T05:38:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.280+0000 7f6543650640 1 -- start start 2024-09-19T05:38:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7f6543650640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653404dec0 0x7f653400d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7f6543650640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65340d6bc0 con 0x7f653404ef40 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7f6543650640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653400bf10 con 0x7f65340d67e0 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7f6543650640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f653404cb70 con 0x7f653404dec0 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7f6541bed640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653404dec0 0x7f653400d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7f6541bed640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653404dec0 0x7f653400d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60690/0 (socket says 172.21.15.103:60690) 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7f6541bed640 1 -- 172.21.15.103:0/3002300313 learned_addr learned my addr 172.21.15.103:0/3002300313 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7f6541bed640 1 -- 172.21.15.103:0/3002300313 >> v1:172.21.15.174:6789/0 conn(0x7f65340d67e0 legacy=0x7f653404e830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7f6541bed640 1 -- 172.21.15.103:0/3002300313 >> v1:172.21.15.103:6789/0 conn(0x7f653404ef40 legacy=0x7f653404d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7f6541bed640 1 -- 172.21.15.103:0/3002300313 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653400c1d0 con 0x7f653404dec0 2024-09-19T05:38:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.284+0000 7f6541bed640 1 --2- 172.21.15.103:0/3002300313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653404dec0 0x7f653400d2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f653c02dd50 tx=0x7f653c0a6fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=817ef1dfe479997a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.279+0000 7ff4129c4640 1 Processor -- start 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.279+0000 7ff4129c4640 1 -- start start 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff4129c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff40c152010 0x7ff40c0c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff4129c4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff40c1523f0 0x7ff40c0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff4129c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40c0c8cb0 con 0x7ff40c070b50 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff4129c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff40c068a90 con 0x7ff40c152010 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff4129c4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff40c0c9ba0 con 0x7ff40c1523f0 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff40b7fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff40c1523f0 0x7ff40c0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff40b7fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff40c1523f0 0x7ff40c0c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:50942/0 (socket says 172.21.15.103:50942) 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff40b7fe640 1 -- 172.21.15.103:0/2730153388 learned_addr learned my addr 172.21.15.103:0/2730153388 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.282+0000 7ff40bfff640 1 --2- 172.21.15.103:0/2730153388 >> v2:172.21.15.103:3300/0 conn(0x7ff40c152010 0x7ff40c0c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7ff40bfff640 1 -- 172.21.15.103:0/2730153388 >> v2:172.21.15.174:3300/0 conn(0x7ff40c1523f0 msgr2=0x7ff40c0c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7ff40bfff640 1 --2- 172.21.15.103:0/2730153388 >> v2:172.21.15.174:3300/0 conn(0x7ff40c1523f0 0x7ff40c0c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7ff40bfff640 1 -- 172.21.15.103:0/2730153388 >> v1:172.21.15.103:6789/0 conn(0x7ff40c070b50 legacy=0x7ff40c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7ff40bfff640 1 -- 172.21.15.103:0/2730153388 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c0c8f90 con 0x7ff40c152010 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7ff40bfff640 1 --2- 172.21.15.103:0/2730153388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c152010 0x7ff40c0c5fe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0c7d00 tx=0x7ff3fc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7914a3b093560c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7fc07a331640 1 Processor -- start 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.283+0000 7fc07a331640 1 -- start start 2024-09-19T05:38:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc07a331640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc0740c9250 0x7fc074163270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc07a331640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0740c9630 0x7fc074160690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc07a331640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0740c7b00 con 0x7fc0740c8890 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc07a331640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc0740c7da0 con 0x7fc0740c9250 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc07a331640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc0740c8080 con 0x7fc0740c9630 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7ff40affd640 1 -- 172.21.15.103:0/2730153388 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc037070 con 0x7ff40c152010 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7ff40affd640 1 -- 172.21.15.103:0/2730153388 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc032440 con 0x7ff40c152010 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7ff40affd640 1 -- 172.21.15.103:0/2730153388 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc032810 con 0x7ff40c152010 2024-09-19T05:38:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7f6533fff640 1 -- 172.21.15.103:0/3002300313 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0b4070 con 0x7f653404dec0 2024-09-19T05:38:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc0788ce640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc0740c8890 0x7fc074158fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:60584/0 (socket says 172.21.15.103:60584) 2024-09-19T05:38:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc0788ce640 1 -- 172.21.15.103:0/3115774459 learned_addr learned my addr 172.21.15.103:0/3115774459 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc073fff640 1 --2- 172.21.15.103:0/3115774459 >> v2:172.21.15.103:3300/0 conn(0x7fc0740c9250 0x7fc074163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc0737fe640 1 --2- 172.21.15.103:0/3115774459 >> v2:172.21.15.174:3300/0 conn(0x7fc0740c9630 0x7fc074160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098465813 0 0) 0x7fc0740c7b00 con 0x7fc0740c8890 2024-09-19T05:38:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc05c003520 con 0x7fc0740c8890 2024-09-19T05:38:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.285+0000 7f6533fff640 1 -- 172.21.15.103:0/3002300313 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653c0a7e00 con 0x7f653404dec0 2024-09-19T05:38:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7f6533fff640 1 -- 172.21.15.103:0/3002300313 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0af640 con 0x7f653404dec0 2024-09-19T05:38:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1977710143 0 0) 0x7fc05c003520 con 0x7fc0740c8890 2024-09-19T05:38:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 >> v2:172.21.15.174:3300/0 conn(0x7fc0740c9630 msgr2=0x7fc074160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 --2- 172.21.15.103:0/3115774459 >> v2:172.21.15.174:3300/0 conn(0x7fc0740c9630 0x7fc074160690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 >> v2:172.21.15.103:3300/0 conn(0x7fc0740c9250 msgr2=0x7fc074163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 --2- 172.21.15.103:0/3115774459 >> v2:172.21.15.103:3300/0 conn(0x7fc0740c9250 0x7fc074163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc074162790 con 0x7fc0740c8890 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fc06c0019f0 con 0x7fc0740c8890 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 >> v1:172.21.15.174:6789/0 conn(0x7fc0740c8890 legacy=0x7fc074158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c004800 0x7fc05c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc05c0051c0 0x7fc05c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0740c7da0 con 0x7fc05c0039b0 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0740c8080 con 0x7fc05c004800 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc05c00c000 con 0x7fc05c0051c0 2024-09-19T05:38:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc073fff640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7f6543650640 1 -- 172.21.15.103:0/3002300313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653404dec0 msgr2=0x7f653400d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7f6543650640 1 --2- 172.21.15.103:0/3002300313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653404dec0 0x7f653400d2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f653c02dd50 tx=0x7f653c0a6fd0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7f6543650640 1 -- 172.21.15.103:0/3002300313 shutdown_connections 2024-09-19T05:38:12.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7f6543650640 1 --2- 172.21.15.103:0/3002300313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f653404dec0 0x7f653400d2a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7f6543650640 1 -- 172.21.15.103:0/3002300313 >> 172.21.15.103:0/3002300313 conn(0x7f653400a160 msgr2=0x7f653400db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.286+0000 7fc0737fe640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c004800 0x7fc05c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7fc073fff640 1 -- 172.21.15.103:0/3115774459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc05c0051c0 msgr2=0x7fc05c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7fc073fff640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc05c0051c0 0x7fc05c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7fc073fff640 1 -- 172.21.15.103:0/3115774459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c004800 msgr2=0x7fc05c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7fc073fff640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c004800 0x7fc05c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7fc073fff640 1 -- 172.21.15.103:0/3115774459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc074162790 con 0x7fc05c0039b0 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7ff4129c4640 1 -- 172.21.15.103:0/2730153388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c152010 msgr2=0x7ff40c0c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7ff4129c4640 1 --2- 172.21.15.103:0/2730153388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c152010 0x7ff40c0c5fe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0c7d00 tx=0x7ff3fc02a250 comp rx=0 tx=0).stop 2024-09-19T05:38:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7f6543650640 1 -- 172.21.15.103:0/3002300313 shutdown_connections 2024-09-19T05:38:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7f6543650640 1 -- 172.21.15.103:0/3002300313 wait complete. 2024-09-19T05:38:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7ff4129c4640 1 -- 172.21.15.103:0/2730153388 shutdown_connections 2024-09-19T05:38:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7ff4129c4640 1 --2- 172.21.15.103:0/2730153388 >> v2:172.21.15.174:3300/0 conn(0x7ff40c1523f0 0x7ff40c0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7ff4129c4640 1 --2- 172.21.15.103:0/2730153388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c152010 0x7ff40c0c5fe0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7ff4129c4640 1 -- 172.21.15.103:0/2730153388 >> 172.21.15.103:0/2730153388 conn(0x7ff40c06cd20 msgr2=0x7ff40c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7fc0788ce640 1 -- 172.21.15.103:0/3115774459 reap_dead start 2024-09-19T05:38:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.287+0000 7f8c657fd640 1 Processor -- start 2024-09-19T05:38:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.288+0000 7f8c657fd640 1 -- start start 2024-09-19T05:38:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.288+0000 7ff4129c4640 1 -- 172.21.15.103:0/2730153388 shutdown_connections 2024-09-19T05:38:12.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.288+0000 7fa090d2b640 1 Processor -- start 2024-09-19T05:38:12.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.288+0000 7fa090d2b640 1 -- start start 2024-09-19T05:38:12.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.288+0000 7fc073fff640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc064009aa0 tx=0x7fc05c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18e6d1a9502cc11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.288+0000 7fa5cdec0640 1 Processor -- start 2024-09-19T05:38:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7fa5cdec0640 1 -- start start 2024-09-19T05:38:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064036070 con 0x7fc05c0039b0 2024-09-19T05:38:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc064031400 con 0x7fc05c0039b0 2024-09-19T05:38:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7f6543650640 1 Processor -- start 2024-09-19T05:38:12.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7f8c657fd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c60152d20 0x7f8c6006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7f8c657fd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6006ce10 0x7f8c60158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7fc072ffd640 1 -- 172.21.15.103:0/3115774459 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064036070 con 0x7fc05c0039b0 2024-09-19T05:38:12.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7f8c5e7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8c60153100 0x7f8c600c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50588/0 (socket says 172.21.15.103:50588) 2024-09-19T05:38:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7ff4129c4640 1 -- 172.21.15.103:0/2730153388 wait complete. 2024-09-19T05:38:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa090d2b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa08c06d770 0x7fa08c06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa090d2b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa08c073690 0x7fa08c06f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa090d2b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa08c06dc00 con 0x7fa08c154bc0 2024-09-19T05:38:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa090d2b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa08c15ed70 con 0x7fa08c073690 2024-09-19T05:38:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa090d2b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa08c15e160 con 0x7fa08c06d770 2024-09-19T05:38:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa08b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa08c154bc0 0x7fa08c15b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50602/0 (socket says 172.21.15.103:50602) 2024-09-19T05:38:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa08b7fe640 1 -- 172.21.15.103:0/3139106316 learned_addr learned my addr 172.21.15.103:0/3139106316 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa08bfff640 1 --2- 172.21.15.103:0/3139106316 >> v2:172.21.15.103:3300/0 conn(0x7fa08c073690 0x7fa08c06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5cdec0640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa5c8152cc0 0x7fa5c8071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5cdec0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80c8a90 con 0x7fa5c81530a0 2024-09-19T05:38:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5cdec0640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80c7f10 con 0x7fa5c815cd80 2024-09-19T05:38:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5cdec0640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80cf570 con 0x7fa5c8152cc0 2024-09-19T05:38:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa08affd640 1 --2- 172.21.15.103:0/3139106316 >> v2:172.21.15.174:3300/0 conn(0x7fa08c06d770 0x7fa08c06f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5c7fff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa5c815cd80 0x7fa5c80c5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:60596/0 (socket says 172.21.15.103:60596) 2024-09-19T05:38:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5c7fff640 1 -- 172.21.15.103:0/2972764622 learned_addr learned my addr 172.21.15.103:0/2972764622 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5c77fe640 1 --2- 172.21.15.103:0/2972764622 >> v2:172.21.15.174:3300/0 conn(0x7fa5c8152cc0 0x7fa5c8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692549511 0 0) 0x7fa5c80c7f10 con 0x7fa5c815cd80 2024-09-19T05:38:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5b4003520 con 0x7fa5c815cd80 2024-09-19T05:38:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fc07a331640 1 -- 172.21.15.103:0/3115774459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 msgr2=0x7fc05c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7fc07a331640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc064009aa0 tx=0x7fc05c005830 comp rx=0 tx=0).stop 2024-09-19T05:38:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa08affd640 1 -- 172.21.15.103:0/3139106316 >> v2:172.21.15.103:3300/0 conn(0x7fa08c073690 msgr2=0x7fa08c06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa08affd640 1 --2- 172.21.15.103:0/3139106316 >> v2:172.21.15.103:3300/0 conn(0x7fa08c073690 0x7fa08c06f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa08affd640 1 -- 172.21.15.103:0/3139106316 >> v1:172.21.15.103:6789/0 conn(0x7fa08c154bc0 legacy=0x7fa08c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa08a7fc640 1 -- 172.21.15.103:0/3139106316 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563837186 0 0) 0x7fa08c06dc00 con 0x7fa08c154bc0 2024-09-19T05:38:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1757765110 0 0) 0x7fa5b4003520 con 0x7fa5c815cd80 2024-09-19T05:38:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa08affd640 1 -- 172.21.15.103:0/3139106316 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c15e440 con 0x7fa08c06d770 2024-09-19T05:38:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 >> v2:172.21.15.174:3300/0 conn(0x7fa5c8152cc0 msgr2=0x7fa5c8071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 --2- 172.21.15.103:0/2972764622 >> v2:172.21.15.174:3300/0 conn(0x7fa5c8152cc0 0x7fa5c8071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 >> v1:172.21.15.103:6789/0 conn(0x7fa5c81530a0 legacy=0x7fa5c815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80c81f0 con 0x7fa5c815cd80 2024-09-19T05:38:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fa5c00019f0 con 0x7fa5c815cd80 2024-09-19T05:38:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 >> v1:172.21.15.174:6789/0 conn(0x7fa5c815cd80 legacy=0x7fa5c80c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5b40039b0 0x7fa5b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b4004800 0x7fa5b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b40051c0 0x7fa5b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80cf570 con 0x7fa5b40051c0 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b400c070 con 0x7fa5b40039b0 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b400c270 con 0x7fa5b4004800 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7fa5c7fff640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b40051c0 0x7fa5b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7ff4129c4640 1 Processor -- start 2024-09-19T05:38:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7ff4129c4640 1 -- start start 2024-09-19T05:38:12.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5c77fe640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5b40039b0 0x7fa5b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fc07a331640 1 -- 172.21.15.103:0/3115774459 shutdown_connections 2024-09-19T05:38:12.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5bffff640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b4004800 0x7fa5b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5c7fff640 1 -- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b4004800 msgr2=0x7fa5b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fc07a331640 1 --2- 172.21.15.103:0/3115774459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fc07a331640 1 -- 172.21.15.103:0/3115774459 >> 172.21.15.103:0/3115774459 conn(0x7fc0740cc730 msgr2=0x7fc0740ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7f6543650640 1 -- start start 2024-09-19T05:38:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5c7fff640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b4004800 0x7fa5b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5c7fff640 1 -- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5b40039b0 msgr2=0x7fa5b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5c7fff640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5b40039b0 0x7fa5b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa08affd640 1 --2- 172.21.15.103:0/3139106316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c06d770 0x7fa08c06f2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0cd580 tx=0x7fa08002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf64adbe7819d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5c7fff640 1 -- 172.21.15.103:0/2972764622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80c81f0 con 0x7fa5b40051c0 2024-09-19T05:38:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5c77fe640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5b40039b0 0x7fa5b4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa5bffff640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b4004800 0x7fa5b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa08a7fc640 1 -- 172.21.15.103:0/3139106316 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080037070 con 0x7fa08c06d770 2024-09-19T05:38:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7fa08a7fc640 1 -- 172.21.15.103:0/3139106316 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa080032440 con 0x7fa08c06d770 2024-09-19T05:38:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7ff4129c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c070b50 0x7ff40c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f6543650640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653404dec0 0x7f65340d9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f6543650640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65340d67e0 0x7f6534050150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f6543650640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6534008ce0 0x7f6534049210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f6543650640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f653400ca70 con 0x7f653404dec0 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f6543650640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f653400c790 con 0x7f6534008ce0 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f6543650640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f653400cde0 con 0x7f65340d67e0 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653404dec0 0x7f65340d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653404dec0 0x7f65340d9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56262/0 (socket says 172.21.15.103:56262) 2024-09-19T05:38:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 -- 172.21.15.103:0/2284489108 learned_addr learned my addr 172.21.15.103:0/2284489108 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.289+0000 7f8c5f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6006ce10 0x7f8c60158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c5f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6006ce10 0x7f8c60158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56236/0 (socket says 172.21.15.103:56236) 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c5e7fc640 1 -- 172.21.15.103:0/3053485627 learned_addr learned my addr 172.21.15.103:0/3053485627 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c5effd640 1 --2- 172.21.15.103:0/3053485627 >> v2:172.21.15.174:3300/0 conn(0x7f8c60152d20 0x7f8c6006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6015c330 con 0x7f8c60153100 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8c6015d190 con 0x7f8c6006ce10 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8c6015c610 con 0x7f8c60152d20 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c5effd640 1 -- 172.21.15.103:0/3053485627 >> v2:172.21.15.103:3300/0 conn(0x7f8c6006ce10 msgr2=0x7f8c60158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c5effd640 1 --2- 172.21.15.103:0/3053485627 >> v2:172.21.15.103:3300/0 conn(0x7f8c6006ce10 0x7f8c60158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.290+0000 7f8c5effd640 1 -- 172.21.15.103:0/3053485627 >> v1:172.21.15.103:6789/0 conn(0x7f8c60153100 legacy=0x7f8c600c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.291+0000 7f8c5effd640 1 -- 172.21.15.103:0/3053485627 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6015c8f0 con 0x7f8c60152d20 2024-09-19T05:38:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f8c5effd640 1 --2- 172.21.15.103:0/3053485627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c6006c8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c600cd610 tx=0x7f8c5003b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ecf97ee62c1ba2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f8c5dffb640 1 -- 172.21.15.103:0/3053485627 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50007740 con 0x7f8c60152d20 2024-09-19T05:38:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f8c5dffb640 1 -- 172.21.15.103:0/3053485627 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c500078e0 con 0x7f8c60152d20 2024-09-19T05:38:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.292+0000 7f8c5dffb640 1 -- 172.21.15.103:0/3053485627 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50007cb0 con 0x7f8c60152d20 2024-09-19T05:38:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa08a7fc640 1 -- 172.21.15.103:0/3139106316 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080037070 con 0x7fa08c06d770 2024-09-19T05:38:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa5c7fff640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b40051c0 0x7fa5b400b9c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000a8b0 tx=0x7fa5b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e87934e93bf32e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa5c7fff640 1 -- 172.21.15.103:0/2972764622 reap_dead start 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 -- 172.21.15.103:0/2284489108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65340d67e0 msgr2=0x7f6534050150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65340d67e0 0x7f6534050150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 -- 172.21.15.103:0/2284489108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6534008ce0 msgr2=0x7f6534049210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6534008ce0 0x7f6534049210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 -- 172.21.15.103:0/2284489108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6534009370 con 0x7f653404dec0 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa090d2b640 1 -- 172.21.15.103:0/3139106316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c06d770 msgr2=0x7fa08c06f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa090d2b640 1 --2- 172.21.15.103:0/3139106316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c06d770 0x7fa08c06f2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0cd580 tx=0x7fa08002a1a0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7ff4129c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40c152010 0x7ff40c1f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa090d2b640 1 -- 172.21.15.103:0/3139106316 shutdown_connections 2024-09-19T05:38:12.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa090d2b640 1 --2- 172.21.15.103:0/3139106316 >> v2:172.21.15.103:3300/0 conn(0x7fa08c073690 0x7fa08c06f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa090d2b640 1 --2- 172.21.15.103:0/3139106316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c06d770 0x7fa08c06f2e0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0cd580 tx=0x7fa08002a1a0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa090d2b640 1 -- 172.21.15.103:0/3139106316 >> 172.21.15.103:0/3139106316 conn(0x7fa08c06e7c0 msgr2=0x7fa08c06ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7ff4129c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40c1f7d90 0x7ff40c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa090d2b640 1 -- 172.21.15.103:0/3139106316 shutdown_connections 2024-09-19T05:38:12.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8009690 con 0x7fa5b40051c0 2024-09-19T05:38:12.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f65413ec640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653404dec0 0x7f65340d9450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f652c00b480 tx=0x7f652c00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c002f070 con 0x7fa5b40051c0 2024-09-19T05:38:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fa5c6ffd640 1 -- 172.21.15.103:0/2972764622 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000a480 con 0x7fa5b40051c0 2024-09-19T05:38:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fa090d2b640 1 -- 172.21.15.103:0/3139106316 wait complete. 2024-09-19T05:38:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 msgr2=0x7f8c6006c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3053485627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c6006c8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c600cd610 tx=0x7f8c5003b560 comp rx=0 tx=0).stop 2024-09-19T05:38:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 shutdown_connections 2024-09-19T05:38:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3053485627 >> v2:172.21.15.103:3300/0 conn(0x7f8c6006ce10 0x7f8c60158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3053485627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c6006c8d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 >> 172.21.15.103:0/3053485627 conn(0x7f8c600c9230 msgr2=0x7f8c600c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 shutdown_connections 2024-09-19T05:38:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7f8c657fd640 1 -- 172.21.15.103:0/3053485627 wait complete. 2024-09-19T05:38:12.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7ff40bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c070b50 0x7ff40c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7ff40bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c070b50 0x7ff40c157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56278/0 (socket says 172.21.15.103:56278) 2024-09-19T05:38:12.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7ff40b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40c152010 0x7ff40c1f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.293+0000 7ff40b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40c152010 0x7ff40c1f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:51024/0 (socket says 172.21.15.103:51024) 2024-09-19T05:38:12.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7ff40bfff640 1 -- 172.21.15.103:0/1669653144 learned_addr learned my addr 172.21.15.103:0/1669653144 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fa5cdec0640 1 -- 172.21.15.103:0/2972764622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b40051c0 msgr2=0x7fa5b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b40051c0 0x7fa5b400b9c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000a8b0 tx=0x7fa5b4005830 comp rx=0 tx=0).stop 2024-09-19T05:38:12.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7ff410f61640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40c1f7d90 0x7ff40c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7f6531ffb640 1 -- 172.21.15.103:0/2284489108 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c014070 con 0x7f653404dec0 2024-09-19T05:38:12.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fc07a331640 1 -- 172.21.15.103:0/3115774459 shutdown_connections 2024-09-19T05:38:12.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7f6531ffb640 1 -- 172.21.15.103:0/2284489108 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652c010890 con 0x7f653404dec0 2024-09-19T05:38:12.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7f6531ffb640 1 -- 172.21.15.103:0/2284489108 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c010c80 con 0x7f653404dec0 2024-09-19T05:38:12.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c0c9830 con 0x7ff40c070b50 2024-09-19T05:38:12.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fa5cdec0640 1 -- 172.21.15.103:0/2972764622 shutdown_connections 2024-09-19T05:38:12.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/2972764622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5b40051c0 0x7fa5b400b9c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7fa5cdec0640 1 -- 172.21.15.103:0/2972764622 >> 172.21.15.103:0/2972764622 conn(0x7fa5c806f910 msgr2=0x7fa5c80735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65340507d0 con 0x7f653404dec0 2024-09-19T05:38:12.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c0c9550 con 0x7ff40c152010 2024-09-19T05:38:12.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6534050d90 con 0x7f653404dec0 2024-09-19T05:38:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.294+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff40c0c9e90 con 0x7ff40c1f7d90 2024-09-19T05:38:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7ff40b7fe640 1 -- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40c1f7d90 msgr2=0x7ff40c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7ff40b7fe640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40c1f7d90 0x7ff40c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7ff40b7fe640 1 -- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c070b50 msgr2=0x7ff40c157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7ff40b7fe640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c070b50 0x7ff40c157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7ff40b7fe640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c1fdb30 con 0x7ff40c152010 2024-09-19T05:38:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7fa090d2b640 1 Processor -- start 2024-09-19T05:38:12.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.295+0000 7fc07a331640 1 -- 172.21.15.103:0/3115774459 wait complete. 2024-09-19T05:38:12.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.296+0000 7f8c657fd640 1 Processor -- start 2024-09-19T05:38:12.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.296+0000 7fa5cdec0640 1 -- 172.21.15.103:0/2972764622 shutdown_connections 2024-09-19T05:38:12.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.296+0000 7fa090d2b640 1 -- start start 2024-09-19T05:38:12.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.296+0000 7fa5cdec0640 1 -- 172.21.15.103:0/2972764622 wait complete. 2024-09-19T05:38:12.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.296+0000 7f8c657fd640 1 -- start start 2024-09-19T05:38:12.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65340d1420 con 0x7f653404dec0 2024-09-19T05:38:12.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa090d2b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa08c073690 0x7fa08c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa090d2b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa08c154bc0 0x7fa08c1f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7f8c657fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6006ce10 0x7f8c6014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa090d2b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c0c82c0 0x7fa08c15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa090d2b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c154fa0 con 0x7fa08c154bc0 2024-09-19T05:38:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa090d2b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c15ea00 con 0x7fa08c0c82c0 2024-09-19T05:38:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa08b7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa08c073690 0x7fa08c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7f8c5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6006ce10 0x7f8c6014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7f8c5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6006ce10 0x7f8c6014d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56292/0 (socket says 172.21.15.103:56292) 2024-09-19T05:38:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7f8c5effd640 1 -- 172.21.15.103:0/3689378619 learned_addr learned my addr 172.21.15.103:0/3689378619 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c601ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa08b7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa08c073690 0x7fa08c158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60750/0 (socket says 172.21.15.103:60750) 2024-09-19T05:38:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fa08b7fe640 1 -- 172.21.15.103:0/511916995 learned_addr learned my addr 172.21.15.103:0/511916995 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c073cc0 con 0x7fa08c073690 2024-09-19T05:38:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7f6531ffb640 1 -- 172.21.15.103:0/2284489108 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f652c017070 con 0x7f653404dec0 2024-09-19T05:38:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f6531ffb640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652006c300 0x7f652006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f6531ffb640 1 -- 172.21.15.103:0/2284489108 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f652c08b570 con 0x7f653404dec0 2024-09-19T05:38:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7fa08affd640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa08c154bc0 0x7fa08c1f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7fa08bfff640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c0c82c0 0x7fa08c15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7fa5cdec0640 1 Processor -- start 2024-09-19T05:38:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7fa5cdec0640 1 -- start start 2024-09-19T05:38:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c60153100 0x7f8c6014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f8c5e7fc640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c601ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600c6370 con 0x7f8c6006ce10 2024-09-19T05:38:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6015ceb0 con 0x7f8c60152d20 2024-09-19T05:38:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8c600c64f0 con 0x7f8c60153100 2024-09-19T05:38:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7fa08bfff640 1 -- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa08c073690 msgr2=0x7fa08c158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa08bfff640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa08c073690 0x7fa08c158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa08bfff640 1 -- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa08c154bc0 msgr2=0x7fa08c1f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa08bfff640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa08c154bc0 0x7fa08c1f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa08bfff640 1 -- 172.21.15.103:0/511916995 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c14fd70 con 0x7fa08c0c82c0 2024-09-19T05:38:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.297+0000 7fc07a331640 1 Processor -- start 2024-09-19T05:38:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.298+0000 7fc07a331640 1 -- start start 2024-09-19T05:38:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa08b7fe640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa08c073690 0x7fa08c158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7ff40b7fe640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40c152010 0x7ff40c1f7850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff40000e8b0 tx=0x7ff40000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fc07a331640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc074153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fc07a331640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc074154ed0 0x7fc074152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fc073fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc074153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa08bfff640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c0c82c0 0x7fa08c15bd30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa084007d90 tx=0x7fa08400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa073fff640 1 -- 172.21.15.103:0/511916995 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08400edd0 con 0x7fa08c0c82c0 2024-09-19T05:38:12.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa073fff640 1 -- 172.21.15.103:0/511916995 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa084003990 con 0x7fa08c0c82c0 2024-09-19T05:38:12.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa073fff640 1 -- 172.21.15.103:0/511916995 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084003d80 con 0x7fa08c0c82c0 2024-09-19T05:38:12.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fc073fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc074153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56318/0 (socket says 172.21.15.103:56318) 2024-09-19T05:38:12.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fc073fff640 1 -- 172.21.15.103:0/861733300 learned_addr learned my addr 172.21.15.103:0/861733300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7ff408ff9640 1 -- 172.21.15.103:0/1669653144 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400017070 con 0x7ff40c152010 2024-09-19T05:38:12.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7ff408ff9640 1 -- 172.21.15.103:0/1669653144 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40000c940 con 0x7ff40c152010 2024-09-19T05:38:12.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7f8c5f7fe640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c60153100 0x7f8c6014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7f8c5e7fc640 1 -- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c60153100 msgr2=0x7f8c6014c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c150ac0 con 0x7fa08c0c82c0 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7f8c5e7fc640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c60153100 0x7f8c6014c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7f8c5e7fc640 1 -- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6006ce10 msgr2=0x7f8c6014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa5cdec0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b40051c0 0x7fa5c81f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7fa5cdec0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80cc3e0 0x7fa5c815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5cdec0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c8153ca0 0x7fa5c80cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5cdec0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c815c150 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5cdec0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80c87b0 con 0x7fa5c8153ca0 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5cdec0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80c7b90 con 0x7fa5b40051c0 2024-09-19T05:38:12.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5bffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80cc3e0 0x7fa5c815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5c77fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b40051c0 0x7fa5c81f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5c77fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b40051c0 0x7fa5c81f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60764/0 (socket says 172.21.15.103:60764) 2024-09-19T05:38:12.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5bffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80cc3e0 0x7fa5c815ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56328/0 (socket says 172.21.15.103:56328) 2024-09-19T05:38:12.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5c77fe640 1 -- 172.21.15.103:0/1989903466 learned_addr learned my addr 172.21.15.103:0/1989903466 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:12.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.299+0000 7f6540beb640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652006c300 0x7f652006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c0c8800 con 0x7fa08c0c82c0 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7ff408ff9640 1 -- 172.21.15.103:0/1669653144 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40000cd10 con 0x7ff40c152010 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c14e9f0 con 0x7ff40c152010 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c157c70 con 0x7ff40c152010 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5c7fff640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c8153ca0 0x7fa5c80cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5bffff640 1 -- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b40051c0 msgr2=0x7fa5c81f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5bffff640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b40051c0 0x7fa5c81f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5bffff640 1 -- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c8153ca0 msgr2=0x7fa5c80cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5bffff640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c8153ca0 0x7fa5c80cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5bffff640 1 -- 172.21.15.103:0/1989903466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80cc960 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fc0737fe640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc074154ed0 0x7fc074152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fc07a331640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc074136530 0x7fc074135910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0740c7740 con 0x7fc05c0039b0 2024-09-19T05:38:12.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0740c75c0 con 0x7fc074154ed0 2024-09-19T05:38:12.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc074163270 con 0x7fc074136530 2024-09-19T05:38:12.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.300+0000 7fa5c7fff640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c8153ca0 0x7fa5c80cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7f6540beb640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652006c300 0x7f652006e7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65340ed210 tx=0x7f65380079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fc0788ce640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc074136530 0x7fc074135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fc073fff640 1 -- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc074136530 msgr2=0x7fc074135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fc073fff640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc074136530 0x7fc074135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fc073fff640 1 -- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc074154ed0 msgr2=0x7fc074152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fc073fff640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc074154ed0 0x7fc074152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fc073fff640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc074137920 con 0x7fc05c0039b0 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fc0737fe640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc074154ed0 0x7fc074152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:12.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7fa5bffff640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80cc3e0 0x7fa5c815ae20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000d570 tx=0x7fa5b000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.301+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c0cb190 con 0x7fa08c0c82c0 2024-09-19T05:38:12.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7fc073fff640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc074153d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc064009b00 tx=0x7fc064004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7f8c5e7fc640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6006ce10 0x7f8c6014d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7f8c5e7fc640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c60156c70 con 0x7f8c60152d20 2024-09-19T05:38:12.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7f8c5effd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6006ce10 0x7f8c6014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:12.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7f8c5e7fc640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c601ecbd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c390 tx=0x7f8c4800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7fa073fff640 1 -- 172.21.15.103:0/511916995 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa08401b020 con 0x7fa08c0c82c0 2024-09-19T05:38:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7fa073fff640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa07806c380 0x7fa07806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.303+0000 7fa073fff640 1 -- 172.21.15.103:0/511916995 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa08408b8b0 con 0x7fa08c0c82c0 2024-09-19T05:38:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.303+0000 7fa08b7fe640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa07806c380 0x7fa07806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.302+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40c0ce550 con 0x7ff40c152010 2024-09-19T05:38:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.303+0000 7ff408ff9640 1 -- 172.21.15.103:0/1669653144 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff40001a070 con 0x7ff40c152010 2024-09-19T05:38:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.303+0000 7ff408ff9640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff3f806c2b0 0x7ff3f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.303+0000 7fa08b7fe640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa07806c380 0x7fa07806e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa07c007fd0 tx=0x7fa07c007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.303+0000 7ff408ff9640 1 -- 172.21.15.103:0/1669653144 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff40008b8e0 con 0x7ff40c152010 2024-09-19T05:38:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.303+0000 7ff40bfff640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff3f806c2b0 0x7ff3f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.304+0000 7ff40bfff640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff3f806c2b0 0x7ff3f806e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009560 tx=0x7ff3fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.305+0000 7f6531ffb640 1 -- 172.21.15.103:0/2284489108 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f65340d1420 con 0x7f653404dec0 2024-09-19T05:38:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.305+0000 7fc070ff9640 1 -- 172.21.15.103:0/861733300 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064040020 con 0x7fc05c0039b0 2024-09-19T05:38:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.305+0000 7fa5c4ff9640 1 -- 172.21.15.103:0/1989903466 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0003610 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.305+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c81f12f0 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.305+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c81f4060 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.305+0000 7fa5c4ff9640 1 -- 172.21.15.103:0/1989903466 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b0017070 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.305+0000 7fc070ff9640 1 -- 172.21.15.103:0/861733300 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06403b890 con 0x7fc05c0039b0 2024-09-19T05:38:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.306+0000 7fc070ff9640 1 -- 172.21.15.103:0/861733300 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064036040 con 0x7fc05c0039b0 2024-09-19T05:38:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.306+0000 7fa5c4ff9640 1 -- 172.21.15.103:0/1989903466 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00039d0 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.306+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc074137680 con 0x7fc05c0039b0 2024-09-19T05:38:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.306+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc074153590 con 0x7fc05c0039b0 2024-09-19T05:38:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.306+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c8069380 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.307+0000 7f8c577fe640 1 -- 172.21.15.103:0/3689378619 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48017070 con 0x7f8c60152d20 2024-09-19T05:38:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.307+0000 7fa5c4ff9640 1 -- 172.21.15.103:0/1989903466 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5b0003bf0 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.307+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c60156f10 con 0x7f8c60152d20 2024-09-19T05:38:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.307+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601f05c0 con 0x7f8c60152d20 2024-09-19T05:38:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.307+0000 7fa073fff640 1 -- 172.21.15.103:0/511916995 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa08c0cb190 con 0x7fa08c0c82c0 2024-09-19T05:38:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.307+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0740cabb0 con 0x7fc05c0039b0 2024-09-19T05:38:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.308+0000 7fa5c4ff9640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa5a806c2b0 0x7fa5a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.308+0000 7fa5c4ff9640 1 -- 172.21.15.103:0/1989903466 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa5b008b4f0 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.308+0000 7fc070ff9640 1 -- 172.21.15.103:0/861733300 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc064043020 con 0x7fc05c0039b0 2024-09-19T05:38:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.308+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c600c34a0 con 0x7f8c60152d20 2024-09-19T05:38:12.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.309+0000 7fa5c77fe640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa5a806c2b0 0x7fa5a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.309+0000 7fc070ff9640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc06006c2e0 0x7fc06006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.309+0000 7fc070ff9640 1 -- 172.21.15.103:0/861733300 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc0640abc80 con 0x7fc05c0039b0 2024-09-19T05:38:12.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.309+0000 7fa5c77fe640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa5a806c2b0 0x7fa5a806e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009cb0 tx=0x7fa5b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.309+0000 7fc0737fe640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc06006c2e0 0x7fc06006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.310+0000 7fc0737fe640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc06006c2e0 0x7fc06006e7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc0740c4ea0 tx=0x7fc068008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.311+0000 7f8c577fe640 1 -- 172.21.15.103:0/3689378619 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c48005ce0 con 0x7f8c60152d20 2024-09-19T05:38:12.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.311+0000 7f8c577fe640 1 -- 172.21.15.103:0/3689378619 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48021060 con 0x7f8c60152d20 2024-09-19T05:38:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.311+0000 7ff408ff9640 1 -- 172.21.15.103:0/1669653144 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff40c0ce550 con 0x7ff40c152010 2024-09-19T05:38:12.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.313+0000 7f8c577fe640 1 -- 172.21.15.103:0/3689378619 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8c4801a070 con 0x7f8c60152d20 2024-09-19T05:38:12.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.314+0000 7f8c577fe640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8c4006c2b0 0x7f8c4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.314+0000 7f8c577fe640 1 -- 172.21.15.103:0/3689378619 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8c4808b1d0 con 0x7f8c60152d20 2024-09-19T05:38:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.314+0000 7f8c5effd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8c4006c2b0 0x7f8c4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.315+0000 7f8c5effd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8c4006c2b0 0x7f8c4006e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009bd0 tx=0x7f8c50044040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.317+0000 7fa5c4ff9640 1 -- 172.21.15.103:0/1989903466 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa5b00599d0 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.318+0000 7f8c577fe640 1 -- 172.21.15.103:0/3689378619 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8c600c34a0 con 0x7f8c60152d20 2024-09-19T05:38:12.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.326+0000 7fc070ff9640 1 -- 172.21.15.103:0/861733300 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc0740cabb0 con 0x7fc05c0039b0 2024-09-19T05:38:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.631+0000 7fc2c1ffb640 1 -- 172.21.15.103:0/2531106828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc2d004b140 con 0x7fc2d00dcd10 2024-09-19T05:38:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.632+0000 7fc2c3fff640 1 -- 172.21.15.103:0/2531106828 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2d8074850 con 0x7fc2d00dcd10 2024-09-19T05:38:12.634 INFO:teuthology.orchestra.run.smithi103.stdout:60129542153 2024-09-19T05:38:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.635+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc2bc06c300 msgr2=0x7fc2bc06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.635+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc2bc06c300 0x7fc2bc06e7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009d50 tx=0x7fc2c4009060 comp rx=0 tx=0).stop 2024-09-19T05:38:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 msgr2=0x7fc2d00dbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00dbd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80504d0 tx=0x7fc2d80505e0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 shutdown_connections 2024-09-19T05:38:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc2bc06c300 0x7fc2bc06e7c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d00dcd10 0x7fc2d00dbd90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d004ef20 0x7fc2d0053100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 --2- 172.21.15.103:0/2531106828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d000f670 0x7fc2d00b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.636+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 >> 172.21.15.103:0/2531106828 conn(0x7fc2d0054450 msgr2=0x7fc2d0054830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.637+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 shutdown_connections 2024-09-19T05:38:12.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.637+0000 7fc2ddc5c640 1 -- 172.21.15.103:0/2531106828 wait complete. 2024-09-19T05:38:12.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-09-19T05:38:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.653+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6630005580 con 0x7f665015b0f0 2024-09-19T05:38:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.653+0000 7f6645ffb640 1 -- 172.21.15.103:0/3469831404 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f664807a810 con 0x7f665015b0f0 2024-09-19T05:38:12.656 INFO:teuthology.orchestra.run.smithi103.stdout:60129542153 2024-09-19T05:38:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f663406c3b0 msgr2=0x7f663406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f663406c3b0 0x7f663406e870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f664000a8b0 tx=0x7f6640008040 comp rx=0 tx=0).stop 2024-09-19T05:38:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665015b0f0 msgr2=0x7f665014b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665015b0f0 0x7f665014b3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6648009c90 tx=0x7f6648004a40 comp rx=0 tx=0).stop 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 shutdown_connections 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f663406c3b0 0x7f663406e870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665015b0f0 0x7f665014b3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66500c9af0 0x7f665014c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 --2- 172.21.15.103:0/3469831404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66500c9710 0x7f6650154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 >> 172.21.15.103:0/3469831404 conn(0x7f66500cc730 msgr2=0x7f66500c83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 shutdown_connections 2024-09-19T05:38:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.656+0000 7f663b7fe640 1 -- 172.21.15.103:0/3469831404 wait complete. 2024-09-19T05:38:12.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.7 2024-09-19T05:38:12.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.706+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa08c0c8ae0 con 0x7fa08c0c82c0 2024-09-19T05:38:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.706+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f653400d2a0 con 0x7f653404dec0 2024-09-19T05:38:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.706+0000 7fa073fff640 1 -- 172.21.15.103:0/511916995 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa084059cc0 con 0x7fa08c0c82c0 2024-09-19T05:38:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.707+0000 7f6531ffb640 1 -- 172.21.15.103:0/2284489108 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f652c010e20 con 0x7f653404dec0 2024-09-19T05:38:12.708 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:12.709 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-09-19T05:38:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.708+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa07806c380 msgr2=0x7fa07806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.708+0000 7fa090d2b640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa07806c380 0x7fa07806e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa07c007fd0 tx=0x7fa07c007d60 comp rx=0 tx=0).stop 2024-09-19T05:38:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.708+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c0c82c0 msgr2=0x7fa08c15bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.708+0000 7fa090d2b640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c0c82c0 0x7fa08c15bd30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa084007d90 tx=0x7fa08400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 shutdown_connections 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa07806c380 0x7fa07806e840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa08c0c82c0 0x7fa08c15bd30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa08c154bc0 0x7fa08c1f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 --2- 172.21.15.103:0/511916995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa08c073690 0x7fa08c158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 >> 172.21.15.103:0/511916995 conn(0x7fa08c06e7c0 msgr2=0x7fa08c06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 shutdown_connections 2024-09-19T05:38:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.709+0000 7fa090d2b640 1 -- 172.21.15.103:0/511916995 wait complete. 2024-09-19T05:38:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652006c300 msgr2=0x7f652006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652006c300 0x7f652006e7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65340ed210 tx=0x7f65380079b0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653404dec0 msgr2=0x7f65340d9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653404dec0 0x7f65340d9450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f652c00b480 tx=0x7f652c00b940 comp rx=0 tx=0).stop 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 shutdown_connections 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f652006c300 0x7f652006e7c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6534008ce0 0x7f6534049210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65340d67e0 0x7f6534050150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 --2- 172.21.15.103:0/2284489108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653404dec0 0x7f65340d9450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.710+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 >> 172.21.15.103:0/2284489108 conn(0x7f653400a160 msgr2=0x7f6534004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.711+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 shutdown_connections 2024-09-19T05:38:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.711+0000 7f6543650640 1 -- 172.21.15.103:0/2284489108 wait complete. 2024-09-19T05:38:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.711+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff40c1f81a0 con 0x7ff40c152010 2024-09-19T05:38:12.714 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.712+0000 7ff408ff9640 1 -- 172.21.15.103:0/1669653144 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff400059750 con 0x7ff40c152010 2024-09-19T05:38:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.713+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8c601f00f0 con 0x7f8c60152d20 2024-09-19T05:38:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.713+0000 7f8c577fe640 1 -- 172.21.15.103:0/3689378619 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c48058f90 con 0x7f8c60152d20 2024-09-19T05:38:12.715 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-09-19T05:38:12.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.715+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff3f806c2b0 msgr2=0x7ff3f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.715+0000 7ff4129c4640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff3f806c2b0 0x7ff3f806e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009560 tx=0x7ff3fc02e000 comp rx=0 tx=0).stop 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.715+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40c152010 msgr2=0x7ff40c1f7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.715+0000 7ff4129c4640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40c152010 0x7ff40c1f7850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff40000e8b0 tx=0x7ff40000ed70 comp rx=0 tx=0).stop 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.715+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 shutdown_connections 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.715+0000 7ff4129c4640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff3f806c2b0 0x7ff3f806e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7ff4129c4640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40c1f7d90 0x7ff40c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7ff4129c4640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40c152010 0x7ff40c1f7850 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7ff4129c4640 1 --2- 172.21.15.103:0/1669653144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff40c070b50 0x7ff40c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 >> 172.21.15.103:0/1669653144 conn(0x7ff40c06cd20 msgr2=0x7ff40c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 shutdown_connections 2024-09-19T05:38:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8c4006c2b0 msgr2=0x7f8c4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7ff4129c4640 1 -- 172.21.15.103:0/1669653144 wait complete. 2024-09-19T05:38:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8c4006c2b0 0x7f8c4006e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009bd0 tx=0x7f8c50044040 comp rx=0 tx=0).stop 2024-09-19T05:38:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 msgr2=0x7f8c601ecbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c601ecbd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c390 tx=0x7f8c4800c790 comp rx=0 tx=0).stop 2024-09-19T05:38:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 shutdown_connections 2024-09-19T05:38:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8c4006c2b0 0x7f8c4006e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c60153100 0x7f8c6014c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c60152d20 0x7f8c601ecbd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 --2- 172.21.15.103:0/3689378619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6006ce10 0x7f8c6014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 >> 172.21.15.103:0/3689378619 conn(0x7f8c600c9230 msgr2=0x7f8c600c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 shutdown_connections 2024-09-19T05:38:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.716+0000 7f8c657fd640 1 -- 172.21.15.103:0/3689378619 wait complete. 2024-09-19T05:38:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.719+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa5c8150090 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.720+0000 7fa5c4ff9640 1 -- 172.21.15.103:0/1989903466 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa5b00592d0 con 0x7fa5c80cc3e0 2024-09-19T05:38:12.722 INFO:teuthology.orchestra.run.smithi103.stdout:60129542153 2024-09-19T05:38:12.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa5a806c2b0 msgr2=0x7fa5a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa5a806c2b0 0x7fa5a806e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009cb0 tx=0x7fa5b8009190 comp rx=0 tx=0).stop 2024-09-19T05:38:12.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80cc3e0 msgr2=0x7fa5c815ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80cc3e0 0x7fa5c815ae20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000d570 tx=0x7fa5b000da30 comp rx=0 tx=0).stop 2024-09-19T05:38:12.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 shutdown_connections 2024-09-19T05:38:12.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa5a806c2b0 0x7fa5a806e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c8153ca0 0x7fa5c80cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80cc3e0 0x7fa5c815ae20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 --2- 172.21.15.103:0/1989903466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5b40051c0 0x7fa5c81f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 >> 172.21.15.103:0/1989903466 conn(0x7fa5c806f910 msgr2=0x7fa5c80ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 shutdown_connections 2024-09-19T05:38:12.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.723+0000 7fa5cdec0640 1 -- 172.21.15.103:0/1989903466 wait complete. 2024-09-19T05:38:12.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2024-09-19T05:38:12.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.725+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc074156620 con 0x7fc05c0039b0 2024-09-19T05:38:12.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.725+0000 7fc070ff9640 1 -- 172.21.15.103:0/861733300 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0740cabb0 con 0x7fc05c0039b0 2024-09-19T05:38:12.728 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc06006c2e0 msgr2=0x7fc06006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc06006c2e0 0x7fc06006e7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc0740c4ea0 tx=0x7fc068008040 comp rx=0 tx=0).stop 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 msgr2=0x7fc074153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc074153d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc064009b00 tx=0x7fc064004730 comp rx=0 tx=0).stop 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 shutdown_connections 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc06006c2e0 0x7fc06006e7a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc074136530 0x7fc074135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc074154ed0 0x7fc074152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 --2- 172.21.15.103:0/861733300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0039b0 0x7fc074153d90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 >> 172.21.15.103:0/861733300 conn(0x7fc0740cc730 msgr2=0x7fc07406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 shutdown_connections 2024-09-19T05:38:12.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:12.728+0000 7fc07a331640 1 -- 172.21.15.103:0/861733300 wait complete. 2024-09-19T05:38:12.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.1 2024-09-19T05:38:12.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.4 2024-09-19T05:38:12.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.0 2024-09-19T05:38:12.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-09-19T05:38:12.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.2 2024-09-19T05:38:13.656 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T05:38:13.671 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T05:38:13.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T05:38:13.733 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T05:38:13.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T05:38:13.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T05:38:13.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T05:38:13.744 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T05:38:13.761 INFO:tasks.ceph.mds.e.smithi103.stderr:2024-09-19T05:38:13.760+0000 7f69a286b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T05:38:13.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.793+0000 7f7028bfc640 1 Processor -- start 2024-09-19T05:38:13.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.793+0000 7f7028bfc640 1 -- start start 2024-09-19T05:38:13.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.794+0000 7f7028bfc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7024150db0 0x7f7024072450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.794+0000 7f7028bfc640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70240716d0 con 0x7f702406dc30 2024-09-19T05:38:13.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.794+0000 7f7028bfc640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7024157860 con 0x7f702406f730 2024-09-19T05:38:13.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.794+0000 7f7028bfc640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7024071970 con 0x7f7024150db0 2024-09-19T05:38:13.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.795+0000 7f70237fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7024150db0 0x7f7024072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.796+0000 7f70237fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7024150db0 0x7f7024072450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:51072/0 (socket says 172.21.15.103:51072) 2024-09-19T05:38:13.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.796+0000 7f70237fe640 1 -- 172.21.15.103:0/4221860502 learned_addr learned my addr 172.21.15.103:0/4221860502 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.796+0000 7f70237fe640 1 -- 172.21.15.103:0/4221860502 >> v1:172.21.15.174:6789/0 conn(0x7f702406f730 legacy=0x7f7024161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.796+0000 7f70237fe640 1 -- 172.21.15.103:0/4221860502 >> v1:172.21.15.103:6789/0 conn(0x7f702406dc30 legacy=0x7f70240c7ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:13.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.796+0000 7f70237fe640 1 -- 172.21.15.103:0/4221860502 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7024071c50 con 0x7f7024150db0 2024-09-19T05:38:13.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.798+0000 7f70237fe640 1 --2- 172.21.15.103:0/4221860502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 0x7f7024072450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7018008870 tx=0x7f701802c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e20df48a7c35712 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.798+0000 7f70227fc640 1 -- 172.21.15.103:0/4221860502 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701803a070 con 0x7f7024150db0 2024-09-19T05:38:13.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.798+0000 7f70227fc640 1 -- 172.21.15.103:0/4221860502 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7018032480 con 0x7f7024150db0 2024-09-19T05:38:13.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.799+0000 7f7028bfc640 1 -- 172.21.15.103:0/4221860502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 msgr2=0x7f7024072450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.799+0000 7f7028bfc640 1 --2- 172.21.15.103:0/4221860502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 0x7f7024072450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7018008870 tx=0x7f701802c7e0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.800+0000 7f7028bfc640 1 -- 172.21.15.103:0/4221860502 shutdown_connections 2024-09-19T05:38:13.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.800+0000 7f7028bfc640 1 --2- 172.21.15.103:0/4221860502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 0x7f7024072450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.800+0000 7f7028bfc640 1 -- 172.21.15.103:0/4221860502 >> 172.21.15.103:0/4221860502 conn(0x7f702406e7c0 msgr2=0x7f702406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.801+0000 7f7028bfc640 1 -- 172.21.15.103:0/4221860502 shutdown_connections 2024-09-19T05:38:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.801+0000 7f7028bfc640 1 -- 172.21.15.103:0/4221860502 wait complete. 2024-09-19T05:38:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.802+0000 7f7028bfc640 1 Processor -- start 2024-09-19T05:38:13.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.803+0000 7f7028bfc640 1 -- start start 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.804+0000 7f7028bfc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702406dc30 0x7f7024155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.804+0000 7f7028bfc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f702406f730 0x7f7024155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.804+0000 7f7028bfc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 0x7f70240ba190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.804+0000 7f7028bfc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7024157b40 con 0x7f702406f730 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.804+0000 7f7028bfc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7024073cf0 con 0x7f7024150db0 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.804+0000 7f7028bfc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f702406bc10 con 0x7f702406dc30 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.805+0000 7f7022ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f702406f730 0x7f7024155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.805+0000 7f7022ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f702406f730 0x7f7024155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56338/0 (socket says 172.21.15.103:56338) 2024-09-19T05:38:13.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.805+0000 7f7022ffd640 1 -- 172.21.15.103:0/1164182870 learned_addr learned my addr 172.21.15.103:0/1164182870 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.806+0000 7f7022ffd640 1 -- 172.21.15.103:0/1164182870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702406dc30 msgr2=0x7f7024155240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:13.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.806+0000 7f7022ffd640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702406dc30 0x7f7024155240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.806+0000 7f7022ffd640 1 -- 172.21.15.103:0/1164182870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 msgr2=0x7f70240ba190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:13.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.806+0000 7f7022ffd640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 0x7f70240ba190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.806+0000 7f7022ffd640 1 -- 172.21.15.103:0/1164182870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70241539e0 con 0x7f702406f730 2024-09-19T05:38:13.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.807+0000 7f7022ffd640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f702406f730 0x7f7024155780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f701400b480 tx=0x7f701400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.807+0000 7f700bfff640 1 -- 172.21.15.103:0/1164182870 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014014070 con 0x7f702406f730 2024-09-19T05:38:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.807+0000 7f7028bfc640 1 -- 172.21.15.103:0/1164182870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70241fe290 con 0x7f702406f730 2024-09-19T05:38:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.808+0000 7f7028bfc640 1 -- 172.21.15.103:0/1164182870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70241541d0 con 0x7f702406f730 2024-09-19T05:38:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.810+0000 7f700bfff640 1 -- 172.21.15.103:0/1164182870 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7014010890 con 0x7f702406f730 2024-09-19T05:38:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.810+0000 7f700bfff640 1 -- 172.21.15.103:0/1164182870 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014010c80 con 0x7f702406f730 2024-09-19T05:38:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.811+0000 7f700bfff640 1 -- 172.21.15.103:0/1164182870 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7014017070 con 0x7f702406f730 2024-09-19T05:38:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.811+0000 7f700bfff640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f701006c3b0 0x7f701006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.812+0000 7f700bfff640 1 -- 172.21.15.103:0/1164182870 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f701408b650 con 0x7f702406f730 2024-09-19T05:38:13.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.813+0000 7f7028bfc640 1 -- 172.21.15.103:0/1164182870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7004005290 con 0x7f702406f730 2024-09-19T05:38:13.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.813+0000 7f70237fe640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f701006c3b0 0x7f701006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.822+0000 7f700bfff640 1 -- 172.21.15.103:0/1164182870 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7014010e20 con 0x7f702406f730 2024-09-19T05:38:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.850+0000 7f5472a23640 1 Processor -- start 2024-09-19T05:38:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.851+0000 7f5472a23640 1 -- start start 2024-09-19T05:38:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f5472a23640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f5472a23640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546c157930 con 0x7f546c15b0f0 2024-09-19T05:38:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f70237fe640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f701006c3b0 0x7f701006e870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7018037000 tx=0x7f7018030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f5472a23640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546c157c10 con 0x7f546c0c9af0 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f5472a23640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f546c15a3c0 con 0x7f546c0c9710 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f5470fc0640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f546c0c9af0 0x7f546c150cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:60614/0 (socket says 172.21.15.103:60614) 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f5470fc0640 1 -- 172.21.15.103:0/1437248846 learned_addr learned my addr 172.21.15.103:0/1437248846 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.852+0000 7f546bfff640 1 --2- 172.21.15.103:0/1437248846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.853+0000 7f546bfff640 1 -- 172.21.15.103:0/1437248846 >> v1:172.21.15.174:6789/0 conn(0x7f546c0c9af0 legacy=0x7f546c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.853+0000 7f546bfff640 1 -- 172.21.15.103:0/1437248846 >> v1:172.21.15.103:6789/0 conn(0x7f546c15b0f0 legacy=0x7f546c156e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.853+0000 7f546bfff640 1 -- 172.21.15.103:0/1437248846 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c15a610 con 0x7f546c0c9710 2024-09-19T05:38:13.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.854+0000 7f546bfff640 1 --2- 172.21.15.103:0/1437248846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0c7d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f546c0c3160 tx=0x7f545c02e5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b56f98f08da06af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.855+0000 7f546affd640 1 -- 172.21.15.103:0/1437248846 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c03c070 con 0x7f546c0c9710 2024-09-19T05:38:13.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.855+0000 7f546affd640 1 -- 172.21.15.103:0/1437248846 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c034480 con 0x7f546c0c9710 2024-09-19T05:38:13.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.856+0000 7f5472a23640 1 -- 172.21.15.103:0/1437248846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 msgr2=0x7f546c0c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.856+0000 7f5472a23640 1 --2- 172.21.15.103:0/1437248846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0c7d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f546c0c3160 tx=0x7f545c02e5d0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.856+0000 7f5472a23640 1 -- 172.21.15.103:0/1437248846 shutdown_connections 2024-09-19T05:38:13.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.856+0000 7f5472a23640 1 --2- 172.21.15.103:0/1437248846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0c7d10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.856+0000 7f5472a23640 1 -- 172.21.15.103:0/1437248846 >> 172.21.15.103:0/1437248846 conn(0x7f546c0cc730 msgr2=0x7f546c0ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.856+0000 7f5472a23640 1 -- 172.21.15.103:0/1437248846 shutdown_connections 2024-09-19T05:38:13.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.857+0000 7f5472a23640 1 -- 172.21.15.103:0/1437248846 wait complete. 2024-09-19T05:38:13.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.858+0000 7f5472a23640 1 Processor -- start 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.859+0000 7f5472a23640 1 -- start start 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f5472a23640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f5472a23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f546c0c9af0 0x7f546c159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f546b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f546c0c9af0 0x7f546c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f546b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f546c0c9af0 0x7f546c159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56340/0 (socket says 172.21.15.103:56340) 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f546b7fe640 1 -- 172.21.15.103:0/1241767567 learned_addr learned my addr 172.21.15.103:0/1241767567 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f5472a23640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546c15b0f0 0x7f546c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f546c0c8250 con 0x7f546c0c9af0 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f546c15abd0 con 0x7f546c15b0f0 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.860+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f546c157520 con 0x7f546c0c9710 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.861+0000 7f546b7fe640 1 -- 172.21.15.103:0/1241767567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 msgr2=0x7f546c0732f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.861+0000 7f546b7fe640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0732f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.861+0000 7f546b7fe640 1 -- 172.21.15.103:0/1241767567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546c15b0f0 msgr2=0x7f546c159890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.861+0000 7f546b7fe640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546c15b0f0 0x7f546c159890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.861+0000 7f546b7fe640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c073f70 con 0x7f546c0c9af0 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.861+0000 7f546b7fe640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f546c0c9af0 0x7f546c159350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f546000b7b0 tx=0x7f546000bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.862+0000 7f5468ff9640 1 -- 172.21.15.103:0/1241767567 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460019070 con 0x7f546c0c9af0 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.863+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c149d50 con 0x7f546c0c9af0 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.863+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c14b080 con 0x7f546c0c9af0 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.863+0000 7f5468ff9640 1 -- 172.21.15.103:0/1241767567 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546000c720 con 0x7f546c0c9af0 2024-09-19T05:38:13.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.863+0000 7f5468ff9640 1 -- 172.21.15.103:0/1241767567 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546000cb10 con 0x7f546c0c9af0 2024-09-19T05:38:13.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.866+0000 7f5468ff9640 1 -- 172.21.15.103:0/1241767567 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f546001c070 con 0x7f546c0c9af0 2024-09-19T05:38:13.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.866+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546c0c9050 con 0x7f546c0c9af0 2024-09-19T05:38:13.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.866+0000 7f5468ff9640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f545806c380 0x7f545806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.866+0000 7f5468ff9640 1 -- 172.21.15.103:0/1241767567 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f546008ac60 con 0x7f546c0c9af0 2024-09-19T05:38:13.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.867+0000 7f546bfff640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f545806c380 0x7f545806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.868+0000 7f546bfff640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f545806c380 0x7f545806e840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f545c039000 tx=0x7f545c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.877+0000 7f5468ff9640 1 -- 172.21.15.103:0/1241767567 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f54600589a0 con 0x7f546c0c9af0 2024-09-19T05:38:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.911+0000 7effea08f640 1 Processor -- start 2024-09-19T05:38:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.913+0000 7fcc3b531640 1 Processor -- start 2024-09-19T05:38:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.913+0000 7fd500542640 1 Processor -- start 2024-09-19T05:38:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.913+0000 7fd500542640 1 -- start start 2024-09-19T05:38:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.913+0000 7fcc3b531640 1 -- start start 2024-09-19T05:38:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.913+0000 7effea08f640 1 -- start start 2024-09-19T05:38:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.914+0000 7fbcba52b640 1 Processor -- start 2024-09-19T05:38:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7effea08f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effdc0073e0 0x7effdc0de930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7effea08f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc04f9b0 0x7effdc0dee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7effea08f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effdc0e1e60 con 0x7effdc0d8bd0 2024-09-19T05:38:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7effea08f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7effdc0d8fb0 con 0x7effdc0073e0 2024-09-19T05:38:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7effea08f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7effdc04f7c0 con 0x7effdc04f9b0 2024-09-19T05:38:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.914+0000 7fd500542640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4f80c3980 0x7fd4f81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.914+0000 7fd500542640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f815b110 0x7fd4f8067890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.914+0000 7fd500542640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f80c2600 con 0x7fd4f80c7d70 2024-09-19T05:38:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.914+0000 7fd500542640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f80c9800 con 0x7fd4f80c3980 2024-09-19T05:38:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.914+0000 7fd500542640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f80c34f0 con 0x7fd4f815b110 2024-09-19T05:38:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fd4fdadd640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd4f80c7d70 0x7fd4f806d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:60618/0 (socket says 172.21.15.103:60618) 2024-09-19T05:38:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fd4fdadd640 1 -- 172.21.15.103:0/2839687016 learned_addr learned my addr 172.21.15.103:0/2839687016 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fd4feadf640 1 --2- 172.21.15.103:0/2839687016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f815b110 0x7fd4f8067890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.914+0000 7fbcba52b640 1 -- start start 2024-09-19T05:38:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7effe908d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7effdc0d8bd0 0x7effdc0497e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50624/0 (socket says 172.21.15.103:50624) 2024-09-19T05:38:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fcc3b531640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcc341594c0 0x7fcc34163080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7effe908d640 1 -- 172.21.15.103:0/2985833203 learned_addr learned my addr 172.21.15.103:0/2985833203 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:13.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fcc3b531640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341635c0 0x7fcc34169c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fcc3b531640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc3406c9e0 con 0x7fcc341598a0 2024-09-19T05:38:13.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fcc3b531640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcc3406c740 con 0x7fcc341594c0 2024-09-19T05:38:13.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fcc3b531640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcc341628a0 con 0x7fcc341635c0 2024-09-19T05:38:13.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7ff41f59e640 1 Processor -- start 2024-09-19T05:38:13.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcba52b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbcac00f670 0x7fbcac0e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fcc38acc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcc341598a0 0x7fcc3406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50628/0 (socket says 172.21.15.103:50628) 2024-09-19T05:38:13.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fcc38acc640 1 -- 172.21.15.103:0/2842943952 learned_addr learned my addr 172.21.15.103:0/2842943952 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:13.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcb9d2a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbcac00e3a0 0x7fbcac0ed380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50640/0 (socket says 172.21.15.103:50640) 2024-09-19T05:38:13.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcb9d2a640 1 -- 172.21.15.103:0/3962887533 learned_addr learned my addr 172.21.15.103:0/3962887533 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:13.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac0e39e0 con 0x7fbcac00e3a0 2024-09-19T05:38:13.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac050840 con 0x7fbcac0dcd10 2024-09-19T05:38:13.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbcac04fea0 con 0x7fbcac00f670 2024-09-19T05:38:13.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fcc392cd640 1 --2- 172.21.15.103:0/2842943952 >> v2:172.21.15.103:3300/0 conn(0x7fcc341594c0 0x7fcc34163080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fcc39ace640 1 --2- 172.21.15.103:0/2842943952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341635c0 0x7fcc34169c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7effe888c640 1 --2- 172.21.15.103:0/2985833203 >> v2:172.21.15.103:3300/0 conn(0x7effdc0073e0 0x7effdc0de930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcb8d28640 1 --2- 172.21.15.103:0/3962887533 >> v2:172.21.15.174:3300/0 conn(0x7fbcac00f670 0x7fbcac0e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7effe988e640 1 --2- 172.21.15.103:0/2985833203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc04f9b0 0x7effdc0dee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7effe888c640 1 -- 172.21.15.103:0/2985833203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc04f9b0 msgr2=0x7effdc0dee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7effe888c640 1 --2- 172.21.15.103:0/2985833203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc04f9b0 0x7effdc0dee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7effe888c640 1 -- 172.21.15.103:0/2985833203 >> v1:172.21.15.103:6789/0 conn(0x7effdc0d8bd0 legacy=0x7effdc0497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7effe888c640 1 -- 172.21.15.103:0/2985833203 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc0e2140 con 0x7effdc0073e0 2024-09-19T05:38:13.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fd4feadf640 1 -- 172.21.15.103:0/2839687016 >> v2:172.21.15.103:3300/0 conn(0x7fd4f80c3980 msgr2=0x7fd4f81514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fd4feadf640 1 --2- 172.21.15.103:0/2839687016 >> v2:172.21.15.103:3300/0 conn(0x7fd4f80c3980 0x7fd4f81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fd4feadf640 1 -- 172.21.15.103:0/2839687016 >> v1:172.21.15.174:6789/0 conn(0x7fd4f80c7d70 legacy=0x7fd4f806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.915+0000 7fd4feadf640 1 -- 172.21.15.103:0/2839687016 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f80c28e0 con 0x7fd4f815b110 2024-09-19T05:38:13.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124999810 0 0) 0x7fbcac050840 con 0x7fbcac0dcd10 2024-09-19T05:38:13.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca0003520 con 0x7fbcac0dcd10 2024-09-19T05:38:13.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fd4feadf640 1 --2- 172.21.15.103:0/2839687016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f815b110 0x7fd4f8067890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00097a0 tx=0x7fd4f002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2435349e314eb81c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fd4fd2dc640 1 -- 172.21.15.103:0/2839687016 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0037070 con 0x7fd4f815b110 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1779112327 0 0) 0x7fbca0003520 con 0x7fbcac0dcd10 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 >> v2:172.21.15.174:3300/0 conn(0x7fbcac00f670 msgr2=0x7fbcac0e6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 --2- 172.21.15.103:0/3962887533 >> v2:172.21.15.174:3300/0 conn(0x7fbcac00f670 0x7fbcac0e6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 >> v1:172.21.15.103:6789/0 conn(0x7fbcac00e3a0 legacy=0x7fbcac0ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac050580 con 0x7fbcac0dcd10 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fbcb0001670 con 0x7fbcac0dcd10 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 >> v1:172.21.15.174:6789/0 conn(0x7fbcac0dcd10 legacy=0x7fbcac04e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00039b0 0x7fbca0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca0004800 0x7fbca0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbca00051c0 0x7fbca000b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac04fea0 con 0x7fbca0004800 2024-09-19T05:38:13.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbca000bf80 con 0x7fbca00051c0 2024-09-19T05:38:13.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbca000c180 con 0x7fbca00039b0 2024-09-19T05:38:13.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fd4fd2dc640 1 -- 172.21.15.103:0/2839687016 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f002ada0 con 0x7fd4f815b110 2024-09-19T05:38:13.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fcc392cd640 1 -- 172.21.15.103:0/2842943952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341635c0 msgr2=0x7fcc34169c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fcc392cd640 1 --2- 172.21.15.103:0/2842943952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341635c0 0x7fcc34169c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fcc392cd640 1 -- 172.21.15.103:0/2842943952 >> v1:172.21.15.103:6789/0 conn(0x7fcc341598a0 legacy=0x7fcc3406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fcc392cd640 1 -- 172.21.15.103:0/2842943952 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc34072fa0 con 0x7fcc341594c0 2024-09-19T05:38:13.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcb9d2a640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbca00051c0 0x7fbca000b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.916+0000 7ff41f59e640 1 -- start start 2024-09-19T05:38:13.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7ff41f59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180d8870 0x7ff418049950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7ff41f59e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff4180dee40 0x7ff418049e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7ff41f59e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff418050850 con 0x7ff4180502d0 2024-09-19T05:38:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7ff41f59e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff4180e1c60 con 0x7ff4180dee40 2024-09-19T05:38:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7ff41f59e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff4180e1f40 con 0x7ff4180d8870 2024-09-19T05:38:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7ff41ed9d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff4180dee40 0x7ff418049e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7fbcb9529640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00039b0 0x7fbca0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.917+0000 7ff41ed9d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff4180dee40 0x7ff418049e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:51092/0 (socket says 172.21.15.103:51092) 2024-09-19T05:38:13.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7ff41ed9d640 1 -- 172.21.15.103:0/1746074714 learned_addr learned my addr 172.21.15.103:0/1746074714 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7ff41e59c640 1 --2- 172.21.15.103:0/1746074714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180d8870 0x7ff418049950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7effe888c640 1 --2- 172.21.15.103:0/2985833203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc0073e0 0x7effdc0de930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7effe4076a70 tx=0x7effe40a6e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9857b554eb275161 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fbcb9d2a640 1 -- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00039b0 msgr2=0x7fbca0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fbcb9d2a640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00039b0 0x7fbca0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fbcb9d2a640 1 -- 172.21.15.103:0/3962887533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca0004800 msgr2=0x7fbca0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fbcb9d2a640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca0004800 0x7fbca0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fbcb9d2a640 1 -- 172.21.15.103:0/3962887533 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac050580 con 0x7fbca00051c0 2024-09-19T05:38:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fcc392cd640 1 --2- 172.21.15.103:0/2842943952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc34163080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc240097a0 tx=0x7fcc2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e85ff2f645279c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fd4fd2dc640 1 -- 172.21.15.103:0/2839687016 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0032660 con 0x7fd4f815b110 2024-09-19T05:38:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fd500542640 1 -- 172.21.15.103:0/2839687016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f815b110 msgr2=0x7fd4f8067890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7fd500542640 1 --2- 172.21.15.103:0/2839687016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f815b110 0x7fd4f8067890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00097a0 tx=0x7fd4f002a110 comp rx=0 tx=0).stop 2024-09-19T05:38:13.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7ff41e59c640 1 -- 172.21.15.103:0/1746074714 >> v2:172.21.15.174:3300/0 conn(0x7ff4180dee40 msgr2=0x7ff418049e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7ff41e59c640 1 --2- 172.21.15.103:0/1746074714 >> v2:172.21.15.174:3300/0 conn(0x7ff4180dee40 0x7ff418049e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7ff41e59c640 1 -- 172.21.15.103:0/1746074714 >> v1:172.21.15.103:6789/0 conn(0x7ff4180502d0 legacy=0x7ff4180de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fd500542640 1 -- 172.21.15.103:0/2839687016 shutdown_connections 2024-09-19T05:38:13.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fd500542640 1 --2- 172.21.15.103:0/2839687016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f815b110 0x7fd4f8067890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fd500542640 1 --2- 172.21.15.103:0/2839687016 >> v2:172.21.15.103:3300/0 conn(0x7fd4f80c3980 0x7fd4f81514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fd500542640 1 -- 172.21.15.103:0/2839687016 >> 172.21.15.103:0/2839687016 conn(0x7fd4f80c9990 msgr2=0x7fd4f80c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.918+0000 7ff41e59c640 1 -- 172.21.15.103:0/1746074714 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4180e2220 con 0x7ff4180d8870 2024-09-19T05:38:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fbcb9d2a640 1 -- 172.21.15.103:0/3962887533 reap_dead start 2024-09-19T05:38:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fd500542640 1 -- 172.21.15.103:0/2839687016 shutdown_connections 2024-09-19T05:38:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7effdbfff640 1 -- 172.21.15.103:0/2985833203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40b4070 con 0x7effdc0073e0 2024-09-19T05:38:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fcc2bfff640 1 -- 172.21.15.103:0/2842943952 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24037070 con 0x7fcc341594c0 2024-09-19T05:38:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fbcb9d2a640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbca00051c0 0x7fbca000b930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbcb406b7c0 tx=0x7fbca0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18e115605f00ea91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7fd500542640 1 -- 172.21.15.103:0/2839687016 wait complete. 2024-09-19T05:38:13.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7effdbfff640 1 -- 172.21.15.103:0/2985833203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe40a7c10 con 0x7effdc0073e0 2024-09-19T05:38:13.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4063310 con 0x7fbca00051c0 2024-09-19T05:38:13.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb406b120 con 0x7fbca00051c0 2024-09-19T05:38:13.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7effdbfff640 1 -- 172.21.15.103:0/2985833203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40af680 con 0x7effdc0073e0 2024-09-19T05:38:13.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7fbcabfff640 1 -- 172.21.15.103:0/3962887533 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4062630 con 0x7fbca00051c0 2024-09-19T05:38:13.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7fcc2bfff640 1 -- 172.21.15.103:0/2842943952 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2402ae40 con 0x7fcc341594c0 2024-09-19T05:38:13.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7fcc2bfff640 1 -- 172.21.15.103:0/2842943952 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24032660 con 0x7fcc341594c0 2024-09-19T05:38:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.919+0000 7ff41e59c640 1 --2- 172.21.15.103:0/1746074714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180d8870 0x7ff418049950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4100097a0 tx=0x7ff41002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=255666ed81a5f2c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7effea08f640 1 -- 172.21.15.103:0/2985833203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc0073e0 msgr2=0x7effdc0de930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7effea08f640 1 --2- 172.21.15.103:0/2985833203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc0073e0 0x7effdc0de930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7effe4076a70 tx=0x7effe40a6e00 comp rx=0 tx=0).stop 2024-09-19T05:38:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7effea08f640 1 -- 172.21.15.103:0/2985833203 shutdown_connections 2024-09-19T05:38:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7ff41d59a640 1 -- 172.21.15.103:0/1746074714 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410037070 con 0x7ff4180d8870 2024-09-19T05:38:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7ff41d59a640 1 -- 172.21.15.103:0/1746074714 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41002ae40 con 0x7ff4180d8870 2024-09-19T05:38:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.920+0000 7ff41d59a640 1 -- 172.21.15.103:0/1746074714 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410032660 con 0x7ff4180d8870 2024-09-19T05:38:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbca00051c0 msgr2=0x7fbca000b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fbcba52b640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbca00051c0 0x7fbca000b930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbcb406b7c0 tx=0x7fbca0005830 comp rx=0 tx=0).stop 2024-09-19T05:38:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7effea08f640 1 --2- 172.21.15.103:0/2985833203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc04f9b0 0x7effdc0dee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7effea08f640 1 --2- 172.21.15.103:0/2985833203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc0073e0 0x7effdc0de930 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7effe4076a70 tx=0x7effe40a6e00 comp rx=0 tx=0).stop 2024-09-19T05:38:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7effea08f640 1 -- 172.21.15.103:0/2985833203 >> 172.21.15.103:0/2985833203 conn(0x7effdc00e880 msgr2=0x7effdc00fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 -- 172.21.15.103:0/2842943952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 msgr2=0x7fcc34163080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 --2- 172.21.15.103:0/2842943952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc34163080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc240097a0 tx=0x7fcc2402a110 comp rx=0 tx=0).stop 2024-09-19T05:38:13.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7effea08f640 1 -- 172.21.15.103:0/2985833203 shutdown_connections 2024-09-19T05:38:13.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 shutdown_connections 2024-09-19T05:38:13.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fbcba52b640 1 --2- 172.21.15.103:0/3962887533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbca00051c0 0x7fbca000b930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 >> 172.21.15.103:0/3962887533 conn(0x7fbcac054450 msgr2=0x7fbcac054860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7ff41f59e640 1 -- 172.21.15.103:0/1746074714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180d8870 msgr2=0x7ff418049950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 -- 172.21.15.103:0/2842943952 shutdown_connections 2024-09-19T05:38:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 --2- 172.21.15.103:0/2842943952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341635c0 0x7fcc34169c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 --2- 172.21.15.103:0/2842943952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc34163080 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 -- 172.21.15.103:0/2842943952 >> 172.21.15.103:0/2842943952 conn(0x7fcc3406cd20 msgr2=0x7fcc3406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1746074714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180d8870 0x7ff418049950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4100097a0 tx=0x7ff41002a130 comp rx=0 tx=0).stop 2024-09-19T05:38:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 shutdown_connections 2024-09-19T05:38:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 -- 172.21.15.103:0/2842943952 shutdown_connections 2024-09-19T05:38:13.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7ff41f59e640 1 -- 172.21.15.103:0/1746074714 shutdown_connections 2024-09-19T05:38:13.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1746074714 >> v2:172.21.15.174:3300/0 conn(0x7ff4180dee40 0x7ff418049e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1746074714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180d8870 0x7ff418049950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7ff41f59e640 1 -- 172.21.15.103:0/1746074714 >> 172.21.15.103:0/1746074714 conn(0x7ff418054450 msgr2=0x7ff418054860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fbcba52b640 1 -- 172.21.15.103:0/3962887533 wait complete. 2024-09-19T05:38:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fcc3b531640 1 -- 172.21.15.103:0/2842943952 wait complete. 2024-09-19T05:38:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fd500542640 1 Processor -- start 2024-09-19T05:38:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7fd500542640 1 -- start start 2024-09-19T05:38:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.922+0000 7fd500542640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f80c3980 0x7fd4f8153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.921+0000 7effea08f640 1 -- 172.21.15.103:0/2985833203 wait complete. 2024-09-19T05:38:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.922+0000 7fd500542640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f80c7d70 0x7fd4f81fe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.922+0000 7fd500542640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4f815b110 0x7fd4f8200710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.922+0000 7fd500542640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f80c3180 con 0x7fd4f80c7d70 2024-09-19T05:38:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.922+0000 7fd500542640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f80c2ea0 con 0x7fd4f815b110 2024-09-19T05:38:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.922+0000 7fd500542640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f80c22e0 con 0x7fd4f80c3980 2024-09-19T05:38:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7ff41f59e640 1 -- 172.21.15.103:0/1746074714 shutdown_connections 2024-09-19T05:38:13.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7effea08f640 1 Processor -- start 2024-09-19T05:38:13.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fcc3b531640 1 Processor -- start 2024-09-19T05:38:13.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7effea08f640 1 -- start start 2024-09-19T05:38:13.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fcc3b531640 1 -- start start 2024-09-19T05:38:13.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fbcba52b640 1 Processor -- start 2024-09-19T05:38:13.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4feadf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4f815b110 0x7fd4f8200710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7fbcba52b640 1 -- start start 2024-09-19T05:38:13.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f80c3980 0x7fd4f8153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f80c3980 0x7fd4f8153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60838/0 (socket says 172.21.15.103:60838) 2024-09-19T05:38:13.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 -- 172.21.15.103:0/1370132827 learned_addr learned my addr 172.21.15.103:0/1370132827 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7effea08f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc04f9b0 0x7effdc0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fdadd640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f80c7d70 0x7fd4f81fe3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 -- 172.21.15.103:0/1370132827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4f815b110 msgr2=0x7fd4f8200710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4f815b110 0x7fd4f8200710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 -- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f80c7d70 msgr2=0x7fd4f81fe3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f80c7d70 0x7fd4f81fe3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fe2de640 1 -- 172.21.15.103:0/1370132827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f8153d90 con 0x7fd4f80c3980 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7fd4fdadd640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f80c7d70 0x7fd4f81fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7fd4fe2de640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f80c3980 0x7fd4f8153850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400ba80 tx=0x7fd4f400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7fd4eeffd640 1 -- 172.21.15.103:0/1370132827 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4019070 con 0x7fd4f80c3980 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7fd4eeffd640 1 -- 172.21.15.103:0/1370132827 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f400cc20 con 0x7fd4f80c3980 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7fd4eeffd640 1 -- 172.21.15.103:0/1370132827 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4014440 con 0x7fd4f80c3980 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f81f7580 con 0x7fd4f80c3980 2024-09-19T05:38:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f80c6ed0 con 0x7fd4f80c3980 2024-09-19T05:38:13.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7effea08f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc0d8bd0 0x7effdc0bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7effea08f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effdc0c9970 0x7effdc0bc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7effea08f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0e29e0 con 0x7effdc04f9b0 2024-09-19T05:38:13.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7effea08f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0e2700 con 0x7effdc0c9970 2024-09-19T05:38:13.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.924+0000 7effea08f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7effdc04f460 con 0x7effdc0d8bd0 2024-09-19T05:38:13.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc3b531640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc341f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.923+0000 7ff41f59e640 1 -- 172.21.15.103:0/1746074714 wait complete. 2024-09-19T05:38:13.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7ff41f59e640 1 Processor -- start 2024-09-19T05:38:13.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc392cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc341f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc392cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc341f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56386/0 (socket says 172.21.15.103:56386) 2024-09-19T05:38:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc392cd640 1 -- 172.21.15.103:0/3792707842 learned_addr learned my addr 172.21.15.103:0/3792707842 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fbcba52b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00051c0 0x7fbcac17ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341598a0 0x7fcc3415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fbcba52b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcac0e5410 0x7fbcac04b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc341635c0 0x7fcc3415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7effe908d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc04f9b0 0x7effdc0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7effe908d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc04f9b0 0x7effdc0ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56392/0 (socket says 172.21.15.103:56392) 2024-09-19T05:38:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fbcb9529640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00051c0 0x7fbcac17ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fbcb9529640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00051c0 0x7fbcac17ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60868/0 (socket says 172.21.15.103:60868) 2024-09-19T05:38:13.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fbcb9529640 1 -- 172.21.15.103:0/1897273522 learned_addr learned my addr 172.21.15.103:0/1897273522 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341607a0 con 0x7fcc341594c0 2024-09-19T05:38:13.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fbcba52b640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcac04d8f0 0x7fbcac0db7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7effe908d640 1 -- 172.21.15.103:0/2853147801 learned_addr learned my addr 172.21.15.103:0/2853147801 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34162b60 con 0x7fcc341635c0 2024-09-19T05:38:13.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3406e220 con 0x7fcc341598a0 2024-09-19T05:38:13.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7effe888c640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc0d8bd0 0x7effdc0bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7fcc39ace640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc341635c0 0x7fcc3415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fbcb8d28640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcac0e5410 0x7fbcac04b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.925+0000 7ff41f59e640 1 -- start start 2024-09-19T05:38:13.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41f59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180502d0 0x7ff4180d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41f59e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4180d8870 0x7ff418184830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fcc392cd640 1 -- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341598a0 msgr2=0x7fcc3415c0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fcc392cd640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341598a0 0x7fcc3415c0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fcc392cd640 1 -- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc341635c0 msgr2=0x7fcc3415c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fcc392cd640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc341635c0 0x7fcc3415c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fcc392cd640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3414bbc0 con 0x7fcc341594c0 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4180dee40 0x7ff418184d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41f59e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4180d8c50 con 0x7ff4180dee40 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41f59e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff41800f720 con 0x7ff4180d8870 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41f59e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff4180d8dd0 con 0x7ff4180502d0 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41e59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180502d0 0x7ff4180d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41dd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4180d8870 0x7ff418184830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41e59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180502d0 0x7ff4180d6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60880/0 (socket says 172.21.15.103:60880) 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7ff41e59c640 1 -- 172.21.15.103:0/1153009643 learned_addr learned my addr 172.21.15.103:0/1153009643 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7ff41dd9b640 1 -- 172.21.15.103:0/1153009643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180502d0 msgr2=0x7ff4180d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7ff41dd9b640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180502d0 0x7ff4180d6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7ff41dd9b640 1 -- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4180dee40 msgr2=0x7ff418184d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7ff41dd9b640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4180dee40 0x7ff418184d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7ff41dd9b640 1 -- 172.21.15.103:0/1153009643 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4180dc780 con 0x7ff4180d8870 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7effe908d640 1 -- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc0d8bd0 msgr2=0x7effdc0bbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7effe908d640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc0d8bd0 0x7effdc0bbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7effe908d640 1 -- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effdc0c9970 msgr2=0x7effdc0bc450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:13.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7effe908d640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effdc0c9970 0x7effdc0bc450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7effe908d640 1 -- 172.21.15.103:0/2853147801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc0ca810 con 0x7effdc04f9b0 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7effe908d640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc04f9b0 0x7effdc0ba320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effd400c6b0 tx=0x7effd400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7effe888c640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc0d8bd0 0x7effdc0bbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fcc392cd640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc341f8c40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc240098c0 tx=0x7fcc240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0e31e0 con 0x7fbcac04d8f0 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0e2f00 con 0x7fbcac0e5410 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.926+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbcac0e34c0 con 0x7fbca00051c0 2024-09-19T05:38:13.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fbcb9d2a640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcac04d8f0 0x7fbcac0db7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e0005290 con 0x7fd4f80c3980 2024-09-19T05:38:13.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7ff41dd9b640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4180d8870 0x7ff418184830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c410 tx=0x7ff41400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fcc29ffb640 1 -- 172.21.15.103:0/3792707842 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24041030 con 0x7fcc341594c0 2024-09-19T05:38:13.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fcc29ffb640 1 -- 172.21.15.103:0/3792707842 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2402ac40 con 0x7fcc341594c0 2024-09-19T05:38:13.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fcc29ffb640 1 -- 172.21.15.103:0/3792707842 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24037040 con 0x7fcc341594c0 2024-09-19T05:38:13.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fbcb9529640 1 -- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcac0e5410 msgr2=0x7fbcac04b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fbcb9529640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcac0e5410 0x7fbcac04b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fbcb9529640 1 -- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcac04d8f0 msgr2=0x7fbcac0db7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fbcb9529640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcac04d8f0 0x7fbcac0db7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fbcb9529640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac0e58b0 con 0x7fbca00051c0 2024-09-19T05:38:13.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc341f95e0 con 0x7fcc341594c0 2024-09-19T05:38:13.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.927+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc340c7600 con 0x7fcc341594c0 2024-09-19T05:38:13.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.929+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc34068790 con 0x7fcc341594c0 2024-09-19T05:38:13.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.928+0000 7ff40effd640 1 -- 172.21.15.103:0/1153009643 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414017070 con 0x7ff4180d8870 2024-09-19T05:38:13.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.928+0000 7fd4eeffd640 1 -- 172.21.15.103:0/1370132827 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4f401c070 con 0x7fd4f80c3980 2024-09-19T05:38:13.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.928+0000 7fd4eeffd640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4dc06c380 0x7fd4dc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.929+0000 7fd4eeffd640 1 -- 172.21.15.103:0/1370132827 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd4f408b400 con 0x7fd4f80c3980 2024-09-19T05:38:13.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.928+0000 7ff40effd640 1 -- 172.21.15.103:0/1153009643 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414005230 con 0x7ff4180d8870 2024-09-19T05:38:13.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.928+0000 7ff40effd640 1 -- 172.21.15.103:0/1153009643 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4140045e0 con 0x7ff4180d8870 2024-09-19T05:38:13.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.928+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41804b430 con 0x7ff4180d8870 2024-09-19T05:38:13.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.928+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4180de5c0 con 0x7ff4180d8870 2024-09-19T05:38:13.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.929+0000 7fd4fdadd640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4dc06c380 0x7fd4dc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.929+0000 7f942ab33640 1 Processor -- start 2024-09-19T05:38:13.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.929+0000 7effd9ffb640 1 -- 172.21.15.103:0/2853147801 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4017070 con 0x7effdc04f9b0 2024-09-19T05:38:13.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.929+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc0caaf0 con 0x7effdc04f9b0 2024-09-19T05:38:13.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.929+0000 7fbcb9529640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00051c0 0x7fbcac17ccb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e8c0 tx=0x7fbcb000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.930+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc0cb0b0 con 0x7effdc04f9b0 2024-09-19T05:38:13.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.930+0000 7fd4fdadd640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4dc06c380 0x7fd4dc06e840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4f81faba0 tx=0x7fd4e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.930+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff418036e20 con 0x7ff4180d8870 2024-09-19T05:38:13.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.930+0000 7ff40effd640 1 -- 172.21.15.103:0/1153009643 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff41401a070 con 0x7ff4180d8870 2024-09-19T05:38:13.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.930+0000 7f942ab33640 1 -- start start 2024-09-19T05:38:13.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7fcc29ffb640 1 -- 172.21.15.103:0/3792707842 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc24044070 con 0x7fcc341594c0 2024-09-19T05:38:13.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7effd9ffb640 1 -- 172.21.15.103:0/2853147801 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd40058b0 con 0x7effdc04f9b0 2024-09-19T05:38:13.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7effd9ffb640 1 -- 172.21.15.103:0/2853147801 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4005c60 con 0x7effdc04f9b0 2024-09-19T05:38:13.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7ff40effd640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff40006c330 0x7ff40006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7fcc29ffb640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcc2006c380 0x7fcc2006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7ff40effd640 1 -- 172.21.15.103:0/1153009643 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff41408a740 con 0x7ff4180d8870 2024-09-19T05:38:13.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7f942ab33640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f942406f140 0x7f9424163270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7f942ab33640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f94241596f0 0x7f9424160690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7f942ab33640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94240c7b00 con 0x7f942406f520 2024-09-19T05:38:13.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7f942ab33640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f94240c7da0 con 0x7f94241596f0 2024-09-19T05:38:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.931+0000 7f942ab33640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f94240c8080 con 0x7f942406f140 2024-09-19T05:38:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94288cf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f942406f140 0x7f9424163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f9423fff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f942406f520 0x7f9424158fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:60628/0 (socket says 172.21.15.103:60628) 2024-09-19T05:38:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94288cf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f942406f140 0x7f9424163270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:60884/0 (socket says 172.21.15.103:60884) 2024-09-19T05:38:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94288cf640 1 -- 172.21.15.103:0/654035263 learned_addr learned my addr 172.21.15.103:0/654035263 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94290d0640 1 --2- 172.21.15.103:0/654035263 >> v2:172.21.15.103:3300/0 conn(0x7f94241596f0 0x7f9424160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc049350 con 0x7effdc04f9b0 2024-09-19T05:38:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94288cf640 1 -- 172.21.15.103:0/654035263 >> v2:172.21.15.103:3300/0 conn(0x7f94241596f0 msgr2=0x7f9424160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94288cf640 1 --2- 172.21.15.103:0/654035263 >> v2:172.21.15.103:3300/0 conn(0x7f94241596f0 0x7f9424160690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94288cf640 1 -- 172.21.15.103:0/654035263 >> v1:172.21.15.174:6789/0 conn(0x7f942406f520 legacy=0x7f9424158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94288cf640 1 -- 172.21.15.103:0/654035263 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9424162790 con 0x7f942406f140 2024-09-19T05:38:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7f94290d0640 1 --2- 172.21.15.103:0/654035263 >> v2:172.21.15.103:3300/0 conn(0x7f94241596f0 0x7f9424160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:13.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.932+0000 7fcc29ffb640 1 -- 172.21.15.103:0/3792707842 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcc240abcc0 con 0x7fcc341594c0 2024-09-19T05:38:13.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7ff41e59c640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff40006c330 0x7ff40006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7effd9ffb640 1 -- 172.21.15.103:0/2853147801 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7effd401a070 con 0x7effdc04f9b0 2024-09-19T05:38:13.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7fcc38acc640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcc2006c380 0x7fcc2006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7fbca9ffb640 1 -- 172.21.15.103:0/1897273522 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00052e0 con 0x7fbca00051c0 2024-09-19T05:38:13.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7fbca9ffb640 1 -- 172.21.15.103:0/1897273522 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0018070 con 0x7fbca00051c0 2024-09-19T05:38:13.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac04cb30 con 0x7fbca00051c0 2024-09-19T05:38:13.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7f94288cf640 1 --2- 172.21.15.103:0/654035263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f942406f140 0x7f9424163270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9418009870 tx=0x7f941802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2912164520a06c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7effd9ffb640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7effc806c3b0 0x7effc806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7fcc38acc640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcc2006c380 0x7fcc2006e840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc3414ab60 tx=0x7fcc30007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7effe888c640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7effc806c3b0 0x7effc806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.933+0000 7fd4eeffd640 1 -- 172.21.15.103:0/1370132827 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd4f4059250 con 0x7fd4f80c3980 2024-09-19T05:38:13.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.934+0000 7f94237fe640 1 -- 172.21.15.103:0/654035263 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418037070 con 0x7f942406f140 2024-09-19T05:38:13.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.934+0000 7effd9ffb640 1 -- 172.21.15.103:0/2853147801 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7effd408aa00 con 0x7effdc04f9b0 2024-09-19T05:38:13.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.934+0000 7f94237fe640 1 -- 172.21.15.103:0/654035263 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9418032440 con 0x7f942406f140 2024-09-19T05:38:13.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.934+0000 7f94237fe640 1 -- 172.21.15.103:0/654035263 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418032810 con 0x7f942406f140 2024-09-19T05:38:13.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.934+0000 7effe888c640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7effc806c3b0 0x7effc806e870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7effdc0e2df0 tx=0x7effe406b530 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.934+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac04d0f0 con 0x7fbca00051c0 2024-09-19T05:38:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 -- 172.21.15.103:0/654035263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f942406f140 msgr2=0x7f9424163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 --2- 172.21.15.103:0/654035263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f942406f140 0x7f9424163270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9418009870 tx=0x7f941802a250 comp rx=0 tx=0).stop 2024-09-19T05:38:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7ff41e59c640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff40006c330 0x7ff40006e7f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff410009560 tx=0x7ff41002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 -- 172.21.15.103:0/654035263 shutdown_connections 2024-09-19T05:38:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 --2- 172.21.15.103:0/654035263 >> v2:172.21.15.103:3300/0 conn(0x7f94241596f0 0x7f9424160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 --2- 172.21.15.103:0/654035263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f942406f140 0x7f9424163270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 -- 172.21.15.103:0/654035263 >> 172.21.15.103:0/654035263 conn(0x7f94240c9230 msgr2=0x7f94240c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 -- 172.21.15.103:0/654035263 shutdown_connections 2024-09-19T05:38:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.936+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac0dd0f0 con 0x7fbca00051c0 2024-09-19T05:38:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.934+0000 7fbca9ffb640 1 -- 172.21.15.103:0/1897273522 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000c900 con 0x7fbca00051c0 2024-09-19T05:38:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.935+0000 7f942ab33640 1 -- 172.21.15.103:0/654035263 wait complete. 2024-09-19T05:38:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.936+0000 7ff40effd640 1 -- 172.21.15.103:0/1153009643 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff414058690 con 0x7ff4180d8870 2024-09-19T05:38:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.936+0000 7fbca9ffb640 1 -- 172.21.15.103:0/1897273522 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbcb000caa0 con 0x7fbca00051c0 2024-09-19T05:38:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.937+0000 7fbca9ffb640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbc9806c380 0x7fbc9806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.937+0000 7fbcb8d28640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbc9806c380 0x7fbc9806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.937+0000 7f942ab33640 1 Processor -- start 2024-09-19T05:38:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.938+0000 7f942ab33640 1 -- start start 2024-09-19T05:38:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.938+0000 7fbcb8d28640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbc9806c380 0x7fbc9806e840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbcac04c920 tx=0x7fbca4009550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.938+0000 7fbca9ffb640 1 -- 172.21.15.103:0/1897273522 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbcb008af70 con 0x7fbca00051c0 2024-09-19T05:38:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.939+0000 7f942ab33640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f942406f140 0x7f9424072760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.939+0000 7f942ab33640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f942406f520 0x7f9424161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.939+0000 7f94288cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f942406f140 0x7f9424072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.939+0000 7f94288cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f942406f140 0x7f9424072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56430/0 (socket says 172.21.15.103:56430) 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7f94288cf640 1 -- 172.21.15.103:0/1724771047 learned_addr learned my addr 172.21.15.103:0/1724771047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7f942ab33640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94241596f0 0x7f9424152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7f9423fff640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f942406f520 0x7f9424161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7f942ab33640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f94240c75c0 con 0x7f942406f140 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7f942ab33640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9424162d50 con 0x7f942406f520 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7f94290d0640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94241596f0 0x7f9424152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7f942ab33640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f94240c7740 con 0x7f94241596f0 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.941+0000 7f94288cf640 1 -- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94241596f0 msgr2=0x7f9424152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.941+0000 7f94288cf640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94241596f0 0x7f9424152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.941+0000 7f94288cf640 1 -- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f942406f520 msgr2=0x7f9424161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.941+0000 7f94288cf640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f942406f520 0x7f9424161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:13.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.941+0000 7f94288cf640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9424072f10 con 0x7f942406f140 2024-09-19T05:38:13.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.942+0000 7f9423fff640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f942406f520 0x7f9424161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:13.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.942+0000 7f94290d0640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94241596f0 0x7f9424152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:13.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.942+0000 7f94288cf640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f942406f140 0x7f9424072760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9418000c00 tx=0x7f94180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:13.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.940+0000 7fcc29ffb640 1 -- 172.21.15.103:0/3792707842 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcc2407a280 con 0x7fcc341594c0 2024-09-19T05:38:13.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.943+0000 7fbca9ffb640 1 -- 172.21.15.103:0/1897273522 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbcb0058cb0 con 0x7fbca00051c0 2024-09-19T05:38:13.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.949+0000 7effd9ffb640 1 -- 172.21.15.103:0/2853147801 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7effd4058730 con 0x7effdc04f9b0 2024-09-19T05:38:13.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.950+0000 7f94217fa640 1 -- 172.21.15.103:0/1724771047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418041020 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.950+0000 7f94217fa640 1 -- 172.21.15.103:0/1724771047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9418030780 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.950+0000 7f94217fa640 1 -- 172.21.15.103:0/1724771047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418037040 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.951+0000 7f942ab33640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94240717f0 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.951+0000 7f942ab33640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9424071db0 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.955+0000 7f94217fa640 1 -- 172.21.15.103:0/1724771047 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9418044020 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.956+0000 7f94217fa640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f941006c3b0 0x7f941006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.956+0000 7f94217fa640 1 -- 172.21.15.103:0/1724771047 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f94180abed0 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.954+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94240c8890 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.958+0000 7f9423fff640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f941006c3b0 0x7f941006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.966+0000 7f94217fa640 1 -- 172.21.15.103:0/1724771047 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9418080030 con 0x7f942406f140 2024-09-19T05:38:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:13.967+0000 7f9423fff640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f941006c3b0 0x7f941006e870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f94241573a0 tx=0x7f9414009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.195+0000 7f7028bfc640 1 -- 172.21.15.103:0/1164182870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7004005580 con 0x7f702406f730 2024-09-19T05:38:14.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.196+0000 7f700bfff640 1 -- 172.21.15.103:0/1164182870 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7014059af0 con 0x7f702406f730 2024-09-19T05:38:14.197 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:14.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.199+0000 7f7009ffb640 1 -- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f701006c3b0 msgr2=0x7f701006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.199+0000 7f7009ffb640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f701006c3b0 0x7f701006e870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7018037000 tx=0x7f7018030000 comp rx=0 tx=0).stop 2024-09-19T05:38:14.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.199+0000 7f7009ffb640 1 -- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f702406f730 msgr2=0x7f7024155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.200+0000 7f7009ffb640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f702406f730 0x7f7024155780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f701400b480 tx=0x7f701400b940 comp rx=0 tx=0).stop 2024-09-19T05:38:14.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.200+0000 7f7009ffb640 1 -- 172.21.15.103:0/1164182870 shutdown_connections 2024-09-19T05:38:14.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.200+0000 7f7009ffb640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f701006c3b0 0x7f701006e870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.200+0000 7f7009ffb640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7024150db0 0x7f70240ba190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.200+0000 7f7009ffb640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f702406f730 0x7f7024155780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.200+0000 7f7009ffb640 1 --2- 172.21.15.103:0/1164182870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702406dc30 0x7f7024155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.200+0000 7f7009ffb640 1 -- 172.21.15.103:0/1164182870 >> 172.21.15.103:0/1164182870 conn(0x7f702406e7c0 msgr2=0x7f702406cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.201+0000 7f7009ffb640 1 -- 172.21.15.103:0/1164182870 shutdown_connections 2024-09-19T05:38:14.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.201+0000 7f7009ffb640 1 -- 172.21.15.103:0/1164182870 wait complete. 2024-09-19T05:38:14.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2024-09-19T05:38:14.218 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.261+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f546c0c5e30 con 0x7f546c0c9af0 2024-09-19T05:38:14.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.262+0000 7f5468ff9640 1 -- 172.21.15.103:0/1241767567 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f546005cca0 con 0x7f546c0c9af0 2024-09-19T05:38:14.264 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:14.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.265+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f545806c380 msgr2=0x7f545806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.265+0000 7f5472a23640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f545806c380 0x7f545806e840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f545c039000 tx=0x7f545c032000 comp rx=0 tx=0).stop 2024-09-19T05:38:14.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.265+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f546c0c9af0 msgr2=0x7f546c159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.265+0000 7f5472a23640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f546c0c9af0 0x7f546c159350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f546000b7b0 tx=0x7f546000bc70 comp rx=0 tx=0).stop 2024-09-19T05:38:14.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 shutdown_connections 2024-09-19T05:38:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f545806c380 0x7f545806e840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546c15b0f0 0x7f546c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f546c0c9af0 0x7f546c159350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 --2- 172.21.15.103:0/1241767567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f546c0c9710 0x7f546c0732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 >> 172.21.15.103:0/1241767567 conn(0x7f546c0cc730 msgr2=0x7f546c150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 shutdown_connections 2024-09-19T05:38:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.266+0000 7f5472a23640 1 -- 172.21.15.103:0/1241767567 wait complete. 2024-09-19T05:38:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.267+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbcac050020 con 0x7fbca00051c0 2024-09-19T05:38:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.268+0000 7fbca9ffb640 1 -- 172.21.15.103:0/1897273522 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbcb005cfb0 con 0x7fbca00051c0 2024-09-19T05:38:14.270 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-09-19T05:38:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbc9806c380 msgr2=0x7fbc9806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbc9806c380 0x7fbc9806e840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbcac04c920 tx=0x7fbca4009550 comp rx=0 tx=0).stop 2024-09-19T05:38:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00051c0 msgr2=0x7fbcac17ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00051c0 0x7fbcac17ccb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e8c0 tx=0x7fbcb000ed80 comp rx=0 tx=0).stop 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 shutdown_connections 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbc9806c380 0x7fbc9806e840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcac04d8f0 0x7fbcac0db7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcac0e5410 0x7fbcac04b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 --2- 172.21.15.103:0/1897273522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca00051c0 0x7fbcac17ccb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 >> 172.21.15.103:0/1897273522 conn(0x7fbcac054450 msgr2=0x7fbcac054830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 shutdown_connections 2024-09-19T05:38:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.271+0000 7fbcba52b640 1 -- 172.21.15.103:0/1897273522 wait complete. 2024-09-19T05:38:14.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-09-19T05:38:14.285 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2024-09-19T05:38:14.286 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.308+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7effdc04e4b0 con 0x7effdc04f9b0 2024-09-19T05:38:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.308+0000 7effd9ffb640 1 -- 172.21.15.103:0/2853147801 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7effd405ca30 con 0x7effdc04f9b0 2024-09-19T05:38:14.310 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-09-19T05:38:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.310+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7effc806c3b0 msgr2=0x7effc806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.310+0000 7effea08f640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7effc806c3b0 0x7effc806e870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7effdc0e2df0 tx=0x7effe406b530 comp rx=0 tx=0).stop 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.310+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc04f9b0 msgr2=0x7effdc0ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.310+0000 7effea08f640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc04f9b0 0x7effdc0ba320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effd400c6b0 tx=0x7effd400cb70 comp rx=0 tx=0).stop 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.310+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 shutdown_connections 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.310+0000 7effea08f640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7effc806c3b0 0x7effc806e870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.310+0000 7effea08f640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effdc0c9970 0x7effdc0bc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.311+0000 7effea08f640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effdc0d8bd0 0x7effdc0bbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.311+0000 7effea08f640 1 --2- 172.21.15.103:0/2853147801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effdc04f9b0 0x7effdc0ba320 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.311+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 >> 172.21.15.103:0/2853147801 conn(0x7effdc00e880 msgr2=0x7effdc037600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.311+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 shutdown_connections 2024-09-19T05:38:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.311+0000 7effea08f640 1 -- 172.21.15.103:0/2853147801 wait complete. 2024-09-19T05:38:14.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-09-19T05:38:14.323 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.327+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd4e0005580 con 0x7fd4f80c3980 2024-09-19T05:38:14.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.327+0000 7fd4eeffd640 1 -- 172.21.15.103:0/1370132827 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4f405d550 con 0x7fd4f80c3980 2024-09-19T05:38:14.329 INFO:teuthology.orchestra.run.smithi103.stdout:60129542155 2024-09-19T05:38:14.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4dc06c380 msgr2=0x7fd4dc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4dc06c380 0x7fd4dc06e840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4f81faba0 tx=0x7fd4e8009040 comp rx=0 tx=0).stop 2024-09-19T05:38:14.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f80c3980 msgr2=0x7fd4f8153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f80c3980 0x7fd4f8153850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400ba80 tx=0x7fd4f400bf40 comp rx=0 tx=0).stop 2024-09-19T05:38:14.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 shutdown_connections 2024-09-19T05:38:14.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd4dc06c380 0x7fd4dc06e840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4f815b110 0x7fd4f8200710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f80c7d70 0x7fd4f81fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 --2- 172.21.15.103:0/1370132827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f80c3980 0x7fd4f8153850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.329+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 >> 172.21.15.103:0/1370132827 conn(0x7fd4f80c9990 msgr2=0x7fd4f815a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.330+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 shutdown_connections 2024-09-19T05:38:14.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.330+0000 7fd500542640 1 -- 172.21.15.103:0/1370132827 wait complete. 2024-09-19T05:38:14.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.337+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff41804e490 con 0x7ff4180d8870 2024-09-19T05:38:14.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.337+0000 7ff40effd640 1 -- 172.21.15.103:0/1153009643 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff41405c990 con 0x7ff4180d8870 2024-09-19T05:38:14.339 INFO:teuthology.orchestra.run.smithi103.stdout:60129542155 2024-09-19T05:38:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.340+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff40006c330 msgr2=0x7ff40006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.340+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff40006c330 0x7ff40006e7f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff410009560 tx=0x7ff41002e000 comp rx=0 tx=0).stop 2024-09-19T05:38:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4180d8870 msgr2=0x7ff418184830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4180d8870 0x7ff418184830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c410 tx=0x7ff41400c8d0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 shutdown_connections 2024-09-19T05:38:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff40006c330 0x7ff40006e7f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4180dee40 0x7ff418184d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4180d8870 0x7ff418184830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 --2- 172.21.15.103:0/1153009643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4180502d0 0x7ff4180d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 >> 172.21.15.103:0/1153009643 conn(0x7ff418054450 msgr2=0x7ff4180d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 shutdown_connections 2024-09-19T05:38:14.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7ff41f59e640 1 -- 172.21.15.103:0/1153009643 wait complete. 2024-09-19T05:38:14.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2024-09-19T05:38:14.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.341+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcc340c4410 con 0x7fcc341594c0 2024-09-19T05:38:14.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.342+0000 7fcc29ffb640 1 -- 172.21.15.103:0/3792707842 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc24079b80 con 0x7fcc341594c0 2024-09-19T05:38:14.344 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.344 INFO:teuthology.orchestra.run.smithi103.stdout:60129542154 2024-09-19T05:38:14.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.344+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9424159210 con 0x7f942406f140 2024-09-19T05:38:14.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7f94217fa640 1 -- 172.21.15.103:0/1724771047 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94180ab020 con 0x7f942406f140 2024-09-19T05:38:14.346 INFO:teuthology.orchestra.run.smithi103.stdout:55834574859 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcc2006c380 msgr2=0x7fcc2006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcc2006c380 0x7fcc2006e840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc3414ab60 tx=0x7fcc30007a40 comp rx=0 tx=0).stop 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 msgr2=0x7fcc341f8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc341f8c40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc240098c0 tx=0x7fcc240046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 shutdown_connections 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fcc2006c380 0x7fcc2006e840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc341635c0 0x7fcc3415c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc341598a0 0x7fcc3415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 --2- 172.21.15.103:0/3792707842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc341594c0 0x7fcc341f8c40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 >> 172.21.15.103:0/3792707842 conn(0x7fcc3406cd20 msgr2=0x7fcc341609b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 shutdown_connections 2024-09-19T05:38:14.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.345+0000 7fcc3b531640 1 -- 172.21.15.103:0/3792707842 wait complete. 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f941006c3b0 msgr2=0x7f941006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f941006c3b0 0x7f941006e870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f94241573a0 tx=0x7f9414009040 comp rx=0 tx=0).stop 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f942406f140 msgr2=0x7f9424072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f942406f140 0x7f9424072760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9418000c00 tx=0x7f94180046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 shutdown_connections 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f941006c3b0 0x7f941006e870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94241596f0 0x7f9424152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f942406f520 0x7f9424161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 --2- 172.21.15.103:0/1724771047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f942406f140 0x7f9424072760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 >> 172.21.15.103:0/1724771047 conn(0x7f94240c9230 msgr2=0x7f942415f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 shutdown_connections 2024-09-19T05:38:14.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.347+0000 7f940affd640 1 -- 172.21.15.103:0/1724771047 wait complete. 2024-09-19T05:38:14.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2024-09-19T05:38:14.359 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-09-19T05:38:14.361 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2024-09-19T05:38:14.361 DEBUG:teuthology.parallel:result is None 2024-09-19T05:38:14.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:38:14.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.499+0000 7ff1d6ca4640 1 Processor -- start 2024-09-19T05:38:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.499+0000 7ff1d6ca4640 1 -- start start 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d6ca4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d00c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d6ca4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff1d0072ba0 0x7ff1d0073030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d6ca4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d006cbd0 con 0x7ff1d006be80 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d6ca4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d006d190 con 0x7ff1d0072ba0 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d6ca4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d006ceb0 con 0x7ff1d006c260 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d00c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d5241640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff1d0072ba0 0x7ff1d0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d4a40640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff1d006be80 0x7ff1d015eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:60632/0 (socket says 172.21.15.103:60632) 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d4a40640 1 -- 172.21.15.103:0/303347720 learned_addr learned my addr 172.21.15.103:0/303347720 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1c7fff640 1 -- 172.21.15.103:0/303347720 >> v2:172.21.15.174:3300/0 conn(0x7ff1d0072ba0 msgr2=0x7ff1d0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1c7fff640 1 --2- 172.21.15.103:0/303347720 >> v2:172.21.15.174:3300/0 conn(0x7ff1d0072ba0 0x7ff1d0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1c7fff640 1 -- 172.21.15.103:0/303347720 >> v1:172.21.15.174:6789/0 conn(0x7ff1d006be80 legacy=0x7ff1d015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1c7fff640 1 -- 172.21.15.103:0/303347720 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d00720c0 con 0x7ff1d006c260 2024-09-19T05:38:14.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1c77fe640 1 -- 172.21.15.103:0/303347720 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599645820 0 0) 0x7ff1d006cbd0 con 0x7ff1d006be80 2024-09-19T05:38:14.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.500+0000 7ff1d5241640 1 --2- 172.21.15.103:0/303347720 >> v2:172.21.15.174:3300/0 conn(0x7ff1d0072ba0 0x7ff1d0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.501+0000 7ff1c7fff640 1 --2- 172.21.15.103:0/303347720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d00c3590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00097d0 tx=0x7ff1c002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64857d9d5e10d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.501+0000 7ff1c77fe640 1 -- 172.21.15.103:0/303347720 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0037070 con 0x7ff1d006c260 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.501+0000 7ff1c77fe640 1 -- 172.21.15.103:0/303347720 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c0032440 con 0x7ff1d006c260 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.501+0000 7ff1c77fe640 1 -- 172.21.15.103:0/303347720 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0032810 con 0x7ff1d006c260 2024-09-19T05:38:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/303347720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 msgr2=0x7ff1d00c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/303347720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d00c3590 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00097d0 tx=0x7ff1c002a1c0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/303347720 shutdown_connections 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/303347720 >> v2:172.21.15.174:3300/0 conn(0x7ff1d0072ba0 0x7ff1d0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/303347720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d00c3590 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/303347720 >> 172.21.15.103:0/303347720 conn(0x7ff1d00cc9f0 msgr2=0x7ff1d00ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/303347720 shutdown_connections 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.502+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/303347720 wait complete. 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.503+0000 7ff1d6ca4640 1 Processor -- start 2024-09-19T05:38:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.503+0000 7ff1d6ca4640 1 -- start start 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d6ca4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d006be80 0x7ff1d00c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d6ca4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d01f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d6ca4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1d0072ba0 0x7ff1d01f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d6ca4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d015c3a0 con 0x7ff1d006be80 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d6ca4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d0072680 con 0x7ff1d0072ba0 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d6ca4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d00c3ad0 con 0x7ff1d006c260 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d006be80 0x7ff1d00c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d006be80 0x7ff1d00c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56436/0 (socket says 172.21.15.103:56436) 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 -- 172.21.15.103:0/2569503013 learned_addr learned my addr 172.21.15.103:0/2569503013 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1c7fff640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d01f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d5241640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1d0072ba0 0x7ff1d01f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 -- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 msgr2=0x7ff1d01f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d01f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 -- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1d0072ba0 msgr2=0x7ff1d01f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1d0072ba0 0x7ff1d01f0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 -- 172.21.15.103:0/2569503013 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d0149470 con 0x7ff1d006be80 2024-09-19T05:38:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.504+0000 7ff1d4a40640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d006be80 0x7ff1d00c3ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c430 tx=0x7ff1cc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.505+0000 7ff1c57fa640 1 -- 172.21.15.103:0/2569503013 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0074e0 con 0x7ff1d006be80 2024-09-19T05:38:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.505+0000 7ff1c57fa640 1 -- 172.21.15.103:0/2569503013 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc0047e0 con 0x7ff1d006be80 2024-09-19T05:38:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.505+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d0149a70 con 0x7ff1d006be80 2024-09-19T05:38:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.505+0000 7ff1c57fa640 1 -- 172.21.15.103:0/2569503013 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc004bd0 con 0x7ff1d006be80 2024-09-19T05:38:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.505+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d0150da0 con 0x7ff1d006be80 2024-09-19T05:38:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.506+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d014b5c0 con 0x7ff1d006be80 2024-09-19T05:38:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.506+0000 7ff1c57fa640 1 -- 172.21.15.103:0/2569503013 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff1cc011070 con 0x7ff1d006be80 2024-09-19T05:38:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.507+0000 7ff1c57fa640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff1bc06c2b0 0x7ff1bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.507+0000 7ff1c7fff640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff1bc06c2b0 0x7ff1bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.507+0000 7ff1c57fa640 1 -- 172.21.15.103:0/2569503013 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff1cc08b1c0 con 0x7ff1d006be80 2024-09-19T05:38:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.507+0000 7ff1c7fff640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff1bc06c2b0 0x7ff1bc06e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0034000 tx=0x7ff1c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.511+0000 7ff1c57fa640 1 -- 172.21.15.103:0/2569503013 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff1cc059680 con 0x7ff1d006be80 2024-09-19T05:38:14.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.676+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1d014b1a0 con 0x7ff1bc06c2b0 2024-09-19T05:38:14.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.683+0000 7ff1c57fa640 1 -- 172.21.15.103:0/2569503013 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332714 (secure 0 0 0) 0x7ff1d014b1a0 con 0x7ff1bc06c2b0 2024-09-19T05:38:14.688 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:14.690 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff1bc06c2b0 msgr2=0x7ff1bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff1bc06c2b0 0x7ff1bc06e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0034000 tx=0x7ff1c002e000 comp rx=0 tx=0).stop 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d006be80 msgr2=0x7ff1d00c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d006be80 0x7ff1d00c3ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c430 tx=0x7ff1cc00c830 comp rx=0 tx=0).stop 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 shutdown_connections 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff1bc06c2b0 0x7ff1bc06e770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1d0072ba0 0x7ff1d01f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1d006c260 0x7ff1d01f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 --2- 172.21.15.103:0/2569503013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d006be80 0x7ff1d00c3ce0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 >> 172.21.15.103:0/2569503013 conn(0x7ff1d00cc9f0 msgr2=0x7ff1d015c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 shutdown_connections 2024-09-19T05:38:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.687+0000 7ff1d6ca4640 1 -- 172.21.15.103:0/2569503013 wait complete. 2024-09-19T05:38:14.699 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-19T05:38:14.183369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595744,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":235,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218588,"kb_used_data":2372,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756132,"statfs":{"total":773094113280,"available":772870279168,"internally_reserved":0,"allocated":2428928,"data_stored":2084426,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":734,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003283"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526146+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:37:50.526146+0000","last_peered":"2024-09-19T05:37:50.526146+0000","last_clean":"2024-09-19T05:37:50.526146+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:37:50.526146+0000","last_undegraded":"2024-09-19T05:37:50.526146+0000","last_fullsized":"2024-09-19T05:37:50.526146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830894+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:37:49.830894+0000","last_peered":"2024-09-19T05:37:49.830894+0000","last_clean":"2024-09-19T05:37:49.830894+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:37:49.830894+0000","last_undegraded":"2024-09-19T05:37:49.830894+0000","last_fullsized":"2024-09-19T05:37:49.830894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830981+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:37:49.830981+0000","last_peered":"2024-09-19T05:37:49.830981+0000","last_clean":"2024-09-19T05:37:49.830981+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:37:49.830981+0000","last_undegraded":"2024-09-19T05:37:49.830981+0000","last_fullsized":"2024-09-19T05:37:49.830981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525978+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:37:50.525978+0000","last_peered":"2024-09-19T05:37:50.525978+0000","last_clean":"2024-09-19T05:37:50.525978+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:37:50.525978+0000","last_undegraded":"2024-09-19T05:37:50.525978+0000","last_fullsized":"2024-09-19T05:37:50.525978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525568+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:37:50.525568+0000","last_peered":"2024-09-19T05:37:50.525568+0000","last_clean":"2024-09-19T05:37:50.525568+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:37:50.525568+0000","last_undegraded":"2024-09-19T05:37:50.525568+0000","last_fullsized":"2024-09-19T05:37:50.525568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526316+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:37:50.526316+0000","last_peered":"2024-09-19T05:37:50.526316+0000","last_clean":"2024-09-19T05:37:50.526316+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:37:50.526316+0000","last_undegraded":"2024-09-19T05:37:50.526316+0000","last_fullsized":"2024-09-19T05:37:50.526316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836803+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:37:49.836803+0000","last_peered":"2024-09-19T05:37:49.836803+0000","last_clean":"2024-09-19T05:37:49.836803+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:37:49.836803+0000","last_undegraded":"2024-09-19T05:37:49.836803+0000","last_fullsized":"2024-09-19T05:37:49.836803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525961+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:37:50.525961+0000","last_peered":"2024-09-19T05:37:50.525961+0000","last_clean":"2024-09-19T05:37:50.525961+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:37:50.525961+0000","last_undegraded":"2024-09-19T05:37:50.525961+0000","last_fullsized":"2024-09-19T05:37:50.525961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526008+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:37:50.526008+0000","last_peered":"2024-09-19T05:37:50.526008+0000","last_clean":"2024-09-19T05:37:50.526008+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:37:50.526008+0000","last_undegraded":"2024-09-19T05:37:50.526008+0000","last_fullsized":"2024-09-19T05:37:50.526008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836489+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:37:49.836489+0000","last_peered":"2024-09-19T05:37:49.836489+0000","last_clean":"2024-09-19T05:37:49.836489+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:37:49.836489+0000","last_undegraded":"2024-09-19T05:37:49.836489+0000","last_fullsized":"2024-09-19T05:37:49.836489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526194+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:37:50.526194+0000","last_peered":"2024-09-19T05:37:50.526194+0000","last_clean":"2024-09-19T05:37:50.526194+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:37:50.526194+0000","last_undegraded":"2024-09-19T05:37:50.526194+0000","last_fullsized":"2024-09-19T05:37:50.526194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836393+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:37:49.836393+0000","last_peered":"2024-09-19T05:37:49.836393+0000","last_clean":"2024-09-19T05:37:49.836393+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:37:49.836393+0000","last_undegraded":"2024-09-19T05:37:49.836393+0000","last_fullsized":"2024-09-19T05:37:49.836393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.886661+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:38:10.886661+0000","last_peered":"2024-09-19T05:38:10.886661+0000","last_clean":"2024-09-19T05:38:10.886661+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:38:10.886661+0000","last_undegraded":"2024-09-19T05:38:10.886661+0000","last_fullsized":"2024-09-19T05:38:10.886661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527273+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:37:50.527273+0000","last_peered":"2024-09-19T05:37:50.527273+0000","last_clean":"2024-09-19T05:37:50.527273+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:37:50.527273+0000","last_undegraded":"2024-09-19T05:37:50.527273+0000","last_fullsized":"2024-09-19T05:37:50.527273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830473+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:37:49.830473+0000","last_peered":"2024-09-19T05:37:49.830473+0000","last_clean":"2024-09-19T05:37:49.830473+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:37:49.830473+0000","last_undegraded":"2024-09-19T05:37:49.830473+0000","last_fullsized":"2024-09-19T05:37:49.830473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526715+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:37:50.526715+0000","last_peered":"2024-09-19T05:37:50.526715+0000","last_clean":"2024-09-19T05:37:50.526715+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:37:50.526715+0000","last_undegraded":"2024-09-19T05:37:50.526715+0000","last_fullsized":"2024-09-19T05:37:50.526715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526929+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:37:50.526929+0000","last_peered":"2024-09-19T05:37:50.526929+0000","last_clean":"2024-09-19T05:37:50.526929+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:37:50.526929+0000","last_undegraded":"2024-09-19T05:37:50.526929+0000","last_fullsized":"2024-09-19T05:37:50.526929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830185+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:37:49.830185+0000","last_peered":"2024-09-19T05:37:49.830185+0000","last_clean":"2024-09-19T05:37:49.830185+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:37:49.830185+0000","last_undegraded":"2024-09-19T05:37:49.830185+0000","last_fullsized":"2024-09-19T05:37:49.830185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525802+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:37:50.525802+0000","last_peered":"2024-09-19T05:37:50.525802+0000","last_clean":"2024-09-19T05:37:50.525802+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:37:50.525802+0000","last_undegraded":"2024-09-19T05:37:50.525802+0000","last_fullsized":"2024-09-19T05:37:50.525802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526964+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:37:50.526964+0000","last_peered":"2024-09-19T05:37:50.526964+0000","last_clean":"2024-09-19T05:37:50.526964+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:37:50.526964+0000","last_undegraded":"2024-09-19T05:37:50.526964+0000","last_fullsized":"2024-09-19T05:37:50.526964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526748+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:37:50.526748+0000","last_peered":"2024-09-19T05:37:50.526748+0000","last_clean":"2024-09-19T05:37:50.526748+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:37:50.526748+0000","last_undegraded":"2024-09-19T05:37:50.526748+0000","last_fullsized":"2024-09-19T05:37:50.526748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.885103+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:10.885103+0000","last_peered":"2024-09-19T05:38:10.885103+0000","last_clean":"2024-09-19T05:38:10.885103+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:10.885103+0000","last_undegraded":"2024-09-19T05:38:10.885103+0000","last_fullsized":"2024-09-19T05:38:10.885103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526205+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:37:50.526205+0000","last_peered":"2024-09-19T05:37:50.526205+0000","last_clean":"2024-09-19T05:37:50.526205+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:37:50.526205+0000","last_undegraded":"2024-09-19T05:37:50.526205+0000","last_fullsized":"2024-09-19T05:37:50.526205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526013+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:37:50.526013+0000","last_peered":"2024-09-19T05:37:50.526013+0000","last_clean":"2024-09-19T05:37:50.526013+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:37:50.526013+0000","last_undegraded":"2024-09-19T05:37:50.526013+0000","last_fullsized":"2024-09-19T05:37:50.526013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.883920+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:38:10.883920+0000","last_peered":"2024-09-19T05:38:10.883920+0000","last_clean":"2024-09-19T05:38:10.883920+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:38:10.883920+0000","last_undegraded":"2024-09-19T05:38:10.883920+0000","last_fullsized":"2024-09-19T05:38:10.883920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526592+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:37:50.526592+0000","last_peered":"2024-09-19T05:37:50.526592+0000","last_clean":"2024-09-19T05:37:50.526592+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:37:50.526592+0000","last_undegraded":"2024-09-19T05:37:50.526592+0000","last_fullsized":"2024-09-19T05:37:50.526592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830955+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:37:49.830955+0000","last_peered":"2024-09-19T05:37:49.830955+0000","last_clean":"2024-09-19T05:37:49.830955+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:37:49.830955+0000","last_undegraded":"2024-09-19T05:37:49.830955+0000","last_fullsized":"2024-09-19T05:37:49.830955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526862+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:37:50.526862+0000","last_peered":"2024-09-19T05:37:50.526862+0000","last_clean":"2024-09-19T05:37:50.526862+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:37:50.526862+0000","last_undegraded":"2024-09-19T05:37:50.526862+0000","last_fullsized":"2024-09-19T05:37:50.526862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829936+0000","last_change":"2024-09-19T05:37:48.360604+0000","last_active":"2024-09-19T05:37:49.829936+0000","last_peered":"2024-09-19T05:37:49.829936+0000","last_clean":"2024-09-19T05:37:49.829936+0000","last_became_active":"2024-09-19T05:37:48.360142+0000","last_became_peered":"2024-09-19T05:37:48.360142+0000","last_unstale":"2024-09-19T05:37:49.829936+0000","last_undegraded":"2024-09-19T05:37:49.829936+0000","last_fullsized":"2024-09-19T05:37:49.829936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:52.762613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526855+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:37:50.526855+0000","last_peered":"2024-09-19T05:37:50.526855+0000","last_clean":"2024-09-19T05:37:50.526855+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:37:50.526855+0000","last_undegraded":"2024-09-19T05:37:50.526855+0000","last_fullsized":"2024-09-19T05:37:50.526855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526665+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:37:50.526665+0000","last_peered":"2024-09-19T05:37:50.526665+0000","last_clean":"2024-09-19T05:37:50.526665+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:37:50.526665+0000","last_undegraded":"2024-09-19T05:37:50.526665+0000","last_fullsized":"2024-09-19T05:37:50.526665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526178+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:37:50.526178+0000","last_peered":"2024-09-19T05:37:50.526178+0000","last_clean":"2024-09-19T05:37:50.526178+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:37:50.526178+0000","last_undegraded":"2024-09-19T05:37:50.526178+0000","last_fullsized":"2024-09-19T05:37:50.526178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836580+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:37:49.836580+0000","last_peered":"2024-09-19T05:37:49.836580+0000","last_clean":"2024-09-19T05:37:49.836580+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:37:49.836580+0000","last_undegraded":"2024-09-19T05:37:49.836580+0000","last_fullsized":"2024-09-19T05:37:49.836580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526879+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:37:50.526879+0000","last_peered":"2024-09-19T05:37:50.526879+0000","last_clean":"2024-09-19T05:37:50.526879+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:37:50.526879+0000","last_undegraded":"2024-09-19T05:37:50.526879+0000","last_fullsized":"2024-09-19T05:37:50.526879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526516+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:37:50.526516+0000","last_peered":"2024-09-19T05:37:50.526516+0000","last_clean":"2024-09-19T05:37:50.526516+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:37:50.526516+0000","last_undegraded":"2024-09-19T05:37:50.526516+0000","last_fullsized":"2024-09-19T05:37:50.526516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526515+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:37:50.526515+0000","last_peered":"2024-09-19T05:37:50.526515+0000","last_clean":"2024-09-19T05:37:50.526515+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:37:50.526515+0000","last_undegraded":"2024-09-19T05:37:50.526515+0000","last_fullsized":"2024-09-19T05:37:50.526515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836809+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:37:49.836809+0000","last_peered":"2024-09-19T05:37:49.836809+0000","last_clean":"2024-09-19T05:37:49.836809+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:37:49.836809+0000","last_undegraded":"2024-09-19T05:37:49.836809+0000","last_fullsized":"2024-09-19T05:37:49.836809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526796+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:37:50.526796+0000","last_peered":"2024-09-19T05:37:50.526796+0000","last_clean":"2024-09-19T05:37:50.526796+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:37:50.526796+0000","last_undegraded":"2024-09-19T05:37:50.526796+0000","last_fullsized":"2024-09-19T05:37:50.526796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525410+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:37:50.525410+0000","last_peered":"2024-09-19T05:37:50.525410+0000","last_clean":"2024-09-19T05:37:50.525410+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:37:50.525410+0000","last_undegraded":"2024-09-19T05:37:50.525410+0000","last_fullsized":"2024-09-19T05:37:50.525410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525365+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:37:50.525365+0000","last_peered":"2024-09-19T05:37:50.525365+0000","last_clean":"2024-09-19T05:37:50.525365+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:37:50.525365+0000","last_undegraded":"2024-09-19T05:37:50.525365+0000","last_fullsized":"2024-09-19T05:37:50.525365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526961+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:37:50.526961+0000","last_peered":"2024-09-19T05:37:50.526961+0000","last_clean":"2024-09-19T05:37:50.526961+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:37:50.526961+0000","last_undegraded":"2024-09-19T05:37:50.526961+0000","last_fullsized":"2024-09-19T05:37:50.526961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525663+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:37:50.525663+0000","last_peered":"2024-09-19T05:37:50.525663+0000","last_clean":"2024-09-19T05:37:50.525663+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:37:50.525663+0000","last_undegraded":"2024-09-19T05:37:50.525663+0000","last_fullsized":"2024-09-19T05:37:50.525663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525558+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:37:50.525558+0000","last_peered":"2024-09-19T05:37:50.525558+0000","last_clean":"2024-09-19T05:37:50.525558+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:37:50.525558+0000","last_undegraded":"2024-09-19T05:37:50.525558+0000","last_fullsized":"2024-09-19T05:37:50.525558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525931+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:37:50.525931+0000","last_peered":"2024-09-19T05:37:50.525931+0000","last_clean":"2024-09-19T05:37:50.525931+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:37:50.525931+0000","last_undegraded":"2024-09-19T05:37:50.525931+0000","last_fullsized":"2024-09-19T05:37:50.525931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830243+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:37:49.830243+0000","last_peered":"2024-09-19T05:37:49.830243+0000","last_clean":"2024-09-19T05:37:49.830243+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:37:49.830243+0000","last_undegraded":"2024-09-19T05:37:49.830243+0000","last_fullsized":"2024-09-19T05:37:49.830243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.885935+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:10.885935+0000","last_peered":"2024-09-19T05:38:10.885935+0000","last_clean":"2024-09-19T05:38:10.885935+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:10.885935+0000","last_undegraded":"2024-09-19T05:38:10.885935+0000","last_fullsized":"2024-09-19T05:38:10.885935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525629+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:37:50.525629+0000","last_peered":"2024-09-19T05:37:50.525629+0000","last_clean":"2024-09-19T05:37:50.525629+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:37:50.525629+0000","last_undegraded":"2024-09-19T05:37:50.525629+0000","last_fullsized":"2024-09-19T05:37:50.525629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836135+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:37:49.836135+0000","last_peered":"2024-09-19T05:37:49.836135+0000","last_clean":"2024-09-19T05:37:49.836135+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:37:49.836135+0000","last_undegraded":"2024-09-19T05:37:49.836135+0000","last_fullsized":"2024-09-19T05:37:49.836135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526130+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:37:50.526130+0000","last_peered":"2024-09-19T05:37:50.526130+0000","last_clean":"2024-09-19T05:37:50.526130+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:37:50.526130+0000","last_undegraded":"2024-09-19T05:37:50.526130+0000","last_fullsized":"2024-09-19T05:37:50.526130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525763+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:37:50.525763+0000","last_peered":"2024-09-19T05:37:50.525763+0000","last_clean":"2024-09-19T05:37:50.525763+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:37:50.525763+0000","last_undegraded":"2024-09-19T05:37:50.525763+0000","last_fullsized":"2024-09-19T05:37:50.525763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836366+0000","last_change":"2024-09-19T05:37:48.360455+0000","last_active":"2024-09-19T05:37:49.836366+0000","last_peered":"2024-09-19T05:37:49.836366+0000","last_clean":"2024-09-19T05:37:49.836366+0000","last_became_active":"2024-09-19T05:37:48.360015+0000","last_became_peered":"2024-09-19T05:37:48.360015+0000","last_unstale":"2024-09-19T05:37:49.836366+0000","last_undegraded":"2024-09-19T05:37:49.836366+0000","last_fullsized":"2024-09-19T05:37:49.836366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:58.281260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836248+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:37:49.836248+0000","last_peered":"2024-09-19T05:37:49.836248+0000","last_clean":"2024-09-19T05:37:49.836248+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:37:49.836248+0000","last_undegraded":"2024-09-19T05:37:49.836248+0000","last_fullsized":"2024-09-19T05:37:49.836248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526377+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:37:50.526377+0000","last_peered":"2024-09-19T05:37:50.526377+0000","last_clean":"2024-09-19T05:37:50.526377+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:37:50.526377+0000","last_undegraded":"2024-09-19T05:37:50.526377+0000","last_fullsized":"2024-09-19T05:37:50.526377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526335+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:37:50.526335+0000","last_peered":"2024-09-19T05:37:50.526335+0000","last_clean":"2024-09-19T05:37:50.526335+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:37:50.526335+0000","last_undegraded":"2024-09-19T05:37:50.526335+0000","last_fullsized":"2024-09-19T05:37:50.526335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526501+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:37:50.526501+0000","last_peered":"2024-09-19T05:37:50.526501+0000","last_clean":"2024-09-19T05:37:50.526501+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:37:50.526501+0000","last_undegraded":"2024-09-19T05:37:50.526501+0000","last_fullsized":"2024-09-19T05:37:50.526501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525419+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:37:50.525419+0000","last_peered":"2024-09-19T05:37:50.525419+0000","last_clean":"2024-09-19T05:37:50.525419+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:37:50.525419+0000","last_undegraded":"2024-09-19T05:37:50.525419+0000","last_fullsized":"2024-09-19T05:37:50.525419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835474+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:37:49.835474+0000","last_peered":"2024-09-19T05:37:49.835474+0000","last_clean":"2024-09-19T05:37:49.835474+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:37:49.835474+0000","last_undegraded":"2024-09-19T05:37:49.835474+0000","last_fullsized":"2024-09-19T05:37:49.835474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526347+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:37:50.526347+0000","last_peered":"2024-09-19T05:37:50.526347+0000","last_clean":"2024-09-19T05:37:50.526347+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:37:50.526347+0000","last_undegraded":"2024-09-19T05:37:50.526347+0000","last_fullsized":"2024-09-19T05:37:50.526347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526647+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:37:50.526647+0000","last_peered":"2024-09-19T05:37:50.526647+0000","last_clean":"2024-09-19T05:37:50.526647+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:37:50.526647+0000","last_undegraded":"2024-09-19T05:37:50.526647+0000","last_fullsized":"2024-09-19T05:37:50.526647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525843+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:37:50.525843+0000","last_peered":"2024-09-19T05:37:50.525843+0000","last_clean":"2024-09-19T05:37:50.525843+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:37:50.525843+0000","last_undegraded":"2024-09-19T05:37:50.525843+0000","last_fullsized":"2024-09-19T05:37:50.525843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525805+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:37:50.525805+0000","last_peered":"2024-09-19T05:37:50.525805+0000","last_clean":"2024-09-19T05:37:50.525805+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:37:50.525805+0000","last_undegraded":"2024-09-19T05:37:50.525805+0000","last_fullsized":"2024-09-19T05:37:50.525805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525050+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:37:50.525050+0000","last_peered":"2024-09-19T05:37:50.525050+0000","last_clean":"2024-09-19T05:37:50.525050+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:37:50.525050+0000","last_undegraded":"2024-09-19T05:37:50.525050+0000","last_fullsized":"2024-09-19T05:37:50.525050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525789+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:37:50.525789+0000","last_peered":"2024-09-19T05:37:50.525789+0000","last_clean":"2024-09-19T05:37:50.525789+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:37:50.525789+0000","last_undegraded":"2024-09-19T05:37:50.525789+0000","last_fullsized":"2024-09-19T05:37:50.525789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836113+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:37:49.836113+0000","last_peered":"2024-09-19T05:37:49.836113+0000","last_clean":"2024-09-19T05:37:49.836113+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:37:49.836113+0000","last_undegraded":"2024-09-19T05:37:49.836113+0000","last_fullsized":"2024-09-19T05:37:49.836113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836182+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:37:49.836182+0000","last_peered":"2024-09-19T05:37:49.836182+0000","last_clean":"2024-09-19T05:37:49.836182+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:37:49.836182+0000","last_undegraded":"2024-09-19T05:37:49.836182+0000","last_fullsized":"2024-09-19T05:37:49.836182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830874+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:37:49.830874+0000","last_peered":"2024-09-19T05:37:49.830874+0000","last_clean":"2024-09-19T05:37:49.830874+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:37:49.830874+0000","last_undegraded":"2024-09-19T05:37:49.830874+0000","last_fullsized":"2024-09-19T05:37:49.830874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525857+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:37:50.525857+0000","last_peered":"2024-09-19T05:37:50.525857+0000","last_clean":"2024-09-19T05:37:50.525857+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:37:50.525857+0000","last_undegraded":"2024-09-19T05:37:50.525857+0000","last_fullsized":"2024-09-19T05:37:50.525857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.885755+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:38:10.885755+0000","last_peered":"2024-09-19T05:38:10.885755+0000","last_clean":"2024-09-19T05:38:10.885755+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:38:10.885755+0000","last_undegraded":"2024-09-19T05:38:10.885755+0000","last_fullsized":"2024-09-19T05:38:10.885755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830313+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:37:49.830313+0000","last_peered":"2024-09-19T05:37:49.830313+0000","last_clean":"2024-09-19T05:37:49.830313+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:37:49.830313+0000","last_undegraded":"2024-09-19T05:37:49.830313+0000","last_fullsized":"2024-09-19T05:37:49.830313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525852+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:37:50.525852+0000","last_peered":"2024-09-19T05:37:50.525852+0000","last_clean":"2024-09-19T05:37:50.525852+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:37:50.525852+0000","last_undegraded":"2024-09-19T05:37:50.525852+0000","last_fullsized":"2024-09-19T05:37:50.525852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526451+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:37:50.526451+0000","last_peered":"2024-09-19T05:37:50.526451+0000","last_clean":"2024-09-19T05:37:50.526451+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:37:50.526451+0000","last_undegraded":"2024-09-19T05:37:50.526451+0000","last_fullsized":"2024-09-19T05:37:50.526451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836390+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:37:49.836390+0000","last_peered":"2024-09-19T05:37:49.836390+0000","last_clean":"2024-09-19T05:37:49.836390+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:37:49.836390+0000","last_undegraded":"2024-09-19T05:37:49.836390+0000","last_fullsized":"2024-09-19T05:37:49.836390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526036+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:37:50.526036+0000","last_peered":"2024-09-19T05:37:50.526036+0000","last_clean":"2024-09-19T05:37:50.526036+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:37:50.526036+0000","last_undegraded":"2024-09-19T05:37:50.526036+0000","last_fullsized":"2024-09-19T05:37:50.526036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.884330+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:38:10.884330+0000","last_peered":"2024-09-19T05:38:10.884330+0000","last_clean":"2024-09-19T05:38:10.884330+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:38:10.884330+0000","last_undegraded":"2024-09-19T05:38:10.884330+0000","last_fullsized":"2024-09-19T05:38:10.884330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526654+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:37:50.526654+0000","last_peered":"2024-09-19T05:37:50.526654+0000","last_clean":"2024-09-19T05:37:50.526654+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:37:50.526654+0000","last_undegraded":"2024-09-19T05:37:50.526654+0000","last_fullsized":"2024-09-19T05:37:50.526654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527026+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:37:50.527026+0000","last_peered":"2024-09-19T05:37:50.527026+0000","last_clean":"2024-09-19T05:37:50.527026+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:37:50.527026+0000","last_undegraded":"2024-09-19T05:37:50.527026+0000","last_fullsized":"2024-09-19T05:37:50.527026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526407+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:37:50.526407+0000","last_peered":"2024-09-19T05:37:50.526407+0000","last_clean":"2024-09-19T05:37:50.526407+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:37:50.526407+0000","last_undegraded":"2024-09-19T05:37:50.526407+0000","last_fullsized":"2024-09-19T05:37:50.526407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526199+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:37:50.526199+0000","last_peered":"2024-09-19T05:37:50.526199+0000","last_clean":"2024-09-19T05:37:50.526199+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:37:50.526199+0000","last_undegraded":"2024-09-19T05:37:50.526199+0000","last_fullsized":"2024-09-19T05:37:50.526199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526059+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:37:50.526059+0000","last_peered":"2024-09-19T05:37:50.526059+0000","last_clean":"2024-09-19T05:37:50.526059+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:37:50.526059+0000","last_undegraded":"2024-09-19T05:37:50.526059+0000","last_fullsized":"2024-09-19T05:37:50.526059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.889572+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:10.889572+0000","last_peered":"2024-09-19T05:38:10.889572+0000","last_clean":"2024-09-19T05:38:10.889572+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:10.889572+0000","last_undegraded":"2024-09-19T05:38:10.889572+0000","last_fullsized":"2024-09-19T05:38:10.889572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830099+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:37:49.830099+0000","last_peered":"2024-09-19T05:37:49.830099+0000","last_clean":"2024-09-19T05:37:49.830099+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:37:49.830099+0000","last_undegraded":"2024-09-19T05:37:49.830099+0000","last_fullsized":"2024-09-19T05:37:49.830099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836270+0000","last_change":"2024-09-19T05:37:43.798426+0000","last_active":"2024-09-19T05:37:49.836270+0000","last_peered":"2024-09-19T05:37:49.836270+0000","last_clean":"2024-09-19T05:37:49.836270+0000","last_became_active":"2024-09-19T05:37:43.797575+0000","last_became_peered":"2024-09-19T05:37:43.797575+0000","last_unstale":"2024-09-19T05:37:49.836270+0000","last_undegraded":"2024-09-19T05:37:49.836270+0000","last_fullsized":"2024-09-19T05:37:49.836270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:07.139397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.886259+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:38:10.886259+0000","last_peered":"2024-09-19T05:38:10.886259+0000","last_clean":"2024-09-19T05:38:10.886259+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:38:10.886259+0000","last_undegraded":"2024-09-19T05:38:10.886259+0000","last_fullsized":"2024-09-19T05:38:10.886259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830059+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:37:49.830059+0000","last_peered":"2024-09-19T05:37:49.830059+0000","last_clean":"2024-09-19T05:37:49.830059+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:37:49.830059+0000","last_undegraded":"2024-09-19T05:37:49.830059+0000","last_fullsized":"2024-09-19T05:37:49.830059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525638+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:37:50.525638+0000","last_peered":"2024-09-19T05:37:50.525638+0000","last_clean":"2024-09-19T05:37:50.525638+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:37:50.525638+0000","last_undegraded":"2024-09-19T05:37:50.525638+0000","last_fullsized":"2024-09-19T05:37:50.525638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525626+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:37:50.525626+0000","last_peered":"2024-09-19T05:37:50.525626+0000","last_clean":"2024-09-19T05:37:50.525626+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:37:50.525626+0000","last_undegraded":"2024-09-19T05:37:50.525626+0000","last_fullsized":"2024-09-19T05:37:50.525626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836280+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:37:49.836280+0000","last_peered":"2024-09-19T05:37:49.836280+0000","last_clean":"2024-09-19T05:37:49.836280+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:37:49.836280+0000","last_undegraded":"2024-09-19T05:37:49.836280+0000","last_fullsized":"2024-09-19T05:37:49.836280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836846+0000","last_change":"2024-09-19T05:37:47.808596+0000","last_active":"2024-09-19T05:37:49.836846+0000","last_peered":"2024-09-19T05:37:49.836846+0000","last_clean":"2024-09-19T05:37:49.836846+0000","last_became_active":"2024-09-19T05:37:47.808169+0000","last_became_peered":"2024-09-19T05:37:47.808169+0000","last_unstale":"2024-09-19T05:37:49.836846+0000","last_undegraded":"2024-09-19T05:37:49.836846+0000","last_fullsized":"2024-09-19T05:37:49.836846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:44.137286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830088+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:37:49.830088+0000","last_peered":"2024-09-19T05:37:49.830088+0000","last_clean":"2024-09-19T05:37:49.830088+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:37:49.830088+0000","last_undegraded":"2024-09-19T05:37:49.830088+0000","last_fullsized":"2024-09-19T05:37:49.830088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830275+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:37:49.830275+0000","last_peered":"2024-09-19T05:37:49.830275+0000","last_clean":"2024-09-19T05:37:49.830275+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:37:49.830275+0000","last_undegraded":"2024-09-19T05:37:49.830275+0000","last_fullsized":"2024-09-19T05:37:49.830275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836491+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:37:49.836491+0000","last_peered":"2024-09-19T05:37:49.836491+0000","last_clean":"2024-09-19T05:37:49.836491+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:37:49.836491+0000","last_undegraded":"2024-09-19T05:37:49.836491+0000","last_fullsized":"2024-09-19T05:37:49.836491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526741+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:37:50.526741+0000","last_peered":"2024-09-19T05:37:50.526741+0000","last_clean":"2024-09-19T05:37:50.526741+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:37:50.526741+0000","last_undegraded":"2024-09-19T05:37:50.526741+0000","last_fullsized":"2024-09-19T05:37:50.526741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525558+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:37:50.525558+0000","last_peered":"2024-09-19T05:37:50.525558+0000","last_clean":"2024-09-19T05:37:50.525558+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:37:50.525558+0000","last_undegraded":"2024-09-19T05:37:50.525558+0000","last_fullsized":"2024-09-19T05:37:50.525558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.890234+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:38:10.890234+0000","last_peered":"2024-09-19T05:38:10.890234+0000","last_clean":"2024-09-19T05:38:10.890234+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:38:10.890234+0000","last_undegraded":"2024-09-19T05:38:10.890234+0000","last_fullsized":"2024-09-19T05:38:10.890234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526434+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:37:50.526434+0000","last_peered":"2024-09-19T05:37:50.526434+0000","last_clean":"2024-09-19T05:37:50.526434+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:37:50.526434+0000","last_undegraded":"2024-09-19T05:37:50.526434+0000","last_fullsized":"2024-09-19T05:37:50.526434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830768+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:37:49.830768+0000","last_peered":"2024-09-19T05:37:49.830768+0000","last_clean":"2024-09-19T05:37:49.830768+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:37:49.830768+0000","last_undegraded":"2024-09-19T05:37:49.830768+0000","last_fullsized":"2024-09-19T05:37:49.830768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835869+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:37:49.835869+0000","last_peered":"2024-09-19T05:37:49.835869+0000","last_clean":"2024-09-19T05:37:49.835869+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:37:49.835869+0000","last_undegraded":"2024-09-19T05:37:49.835869+0000","last_fullsized":"2024-09-19T05:37:49.835869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525234+0000","last_change":"2024-09-19T05:37:43.791626+0000","last_active":"2024-09-19T05:37:50.525234+0000","last_peered":"2024-09-19T05:37:50.525234+0000","last_clean":"2024-09-19T05:37:50.525234+0000","last_became_active":"2024-09-19T05:37:43.791176+0000","last_became_peered":"2024-09-19T05:37:43.791176+0000","last_unstale":"2024-09-19T05:37:50.525234+0000","last_undegraded":"2024-09-19T05:37:50.525234+0000","last_fullsized":"2024-09-19T05:37:50.525234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:30.947341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836714+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:37:49.836714+0000","last_peered":"2024-09-19T05:37:49.836714+0000","last_clean":"2024-09-19T05:37:49.836714+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:37:49.836714+0000","last_undegraded":"2024-09-19T05:37:49.836714+0000","last_fullsized":"2024-09-19T05:37:49.836714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526338+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:37:50.526338+0000","last_peered":"2024-09-19T05:37:50.526338+0000","last_clean":"2024-09-19T05:37:50.526338+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:37:50.526338+0000","last_undegraded":"2024-09-19T05:37:50.526338+0000","last_fullsized":"2024-09-19T05:37:50.526338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830471+0000","last_change":"2024-09-19T05:37:43.795638+0000","last_active":"2024-09-19T05:37:49.830471+0000","last_peered":"2024-09-19T05:37:49.830471+0000","last_clean":"2024-09-19T05:37:49.830471+0000","last_became_active":"2024-09-19T05:37:43.795360+0000","last_became_peered":"2024-09-19T05:37:43.795360+0000","last_unstale":"2024-09-19T05:37:49.830471+0000","last_undegraded":"2024-09-19T05:37:49.830471+0000","last_fullsized":"2024-09-19T05:37:49.830471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:08.525535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526265+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:37:50.526265+0000","last_peered":"2024-09-19T05:37:50.526265+0000","last_clean":"2024-09-19T05:37:50.526265+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:37:50.526265+0000","last_undegraded":"2024-09-19T05:37:50.526265+0000","last_fullsized":"2024-09-19T05:37:50.526265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836748+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:37:49.836748+0000","last_peered":"2024-09-19T05:37:49.836748+0000","last_clean":"2024-09-19T05:37:49.836748+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:37:49.836748+0000","last_undegraded":"2024-09-19T05:37:49.836748+0000","last_fullsized":"2024-09-19T05:37:49.836748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830871+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:37:49.830871+0000","last_peered":"2024-09-19T05:37:49.830871+0000","last_clean":"2024-09-19T05:37:49.830871+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:37:49.830871+0000","last_undegraded":"2024-09-19T05:37:49.830871+0000","last_fullsized":"2024-09-19T05:37:49.830871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835569+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:37:49.835569+0000","last_peered":"2024-09-19T05:37:49.835569+0000","last_clean":"2024-09-19T05:37:49.835569+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:37:49.835569+0000","last_undegraded":"2024-09-19T05:37:49.835569+0000","last_fullsized":"2024-09-19T05:37:49.835569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830198+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:37:49.830198+0000","last_peered":"2024-09-19T05:37:49.830198+0000","last_clean":"2024-09-19T05:37:49.830198+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:37:49.830198+0000","last_undegraded":"2024-09-19T05:37:49.830198+0000","last_fullsized":"2024-09-19T05:37:49.830198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836658+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:37:49.836658+0000","last_peered":"2024-09-19T05:37:49.836658+0000","last_clean":"2024-09-19T05:37:49.836658+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:37:49.836658+0000","last_undegraded":"2024-09-19T05:37:49.836658+0000","last_fullsized":"2024-09-19T05:37:49.836658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526251+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:37:50.526251+0000","last_peered":"2024-09-19T05:37:50.526251+0000","last_clean":"2024-09-19T05:37:50.526251+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:37:50.526251+0000","last_undegraded":"2024-09-19T05:37:50.526251+0000","last_fullsized":"2024-09-19T05:37:50.526251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836668+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:37:49.836668+0000","last_peered":"2024-09-19T05:37:49.836668+0000","last_clean":"2024-09-19T05:37:49.836668+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:37:49.836668+0000","last_undegraded":"2024-09-19T05:37:49.836668+0000","last_fullsized":"2024-09-19T05:37:49.836668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526418+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:37:50.526418+0000","last_peered":"2024-09-19T05:37:50.526418+0000","last_clean":"2024-09-19T05:37:50.526418+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:37:50.526418+0000","last_undegraded":"2024-09-19T05:37:50.526418+0000","last_fullsized":"2024-09-19T05:37:50.526418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525330+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:37:50.525330+0000","last_peered":"2024-09-19T05:37:50.525330+0000","last_clean":"2024-09-19T05:37:50.525330+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:37:50.525330+0000","last_undegraded":"2024-09-19T05:37:50.525330+0000","last_fullsized":"2024-09-19T05:37:50.525330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836515+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:37:49.836515+0000","last_peered":"2024-09-19T05:37:49.836515+0000","last_clean":"2024-09-19T05:37:49.836515+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:37:49.836515+0000","last_undegraded":"2024-09-19T05:37:49.836515+0000","last_fullsized":"2024-09-19T05:37:49.836515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835454+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:37:49.835454+0000","last_peered":"2024-09-19T05:37:49.835454+0000","last_clean":"2024-09-19T05:37:49.835454+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:37:49.835454+0000","last_undegraded":"2024-09-19T05:37:49.835454+0000","last_fullsized":"2024-09-19T05:37:49.835454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525715+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:37:50.525715+0000","last_peered":"2024-09-19T05:37:50.525715+0000","last_clean":"2024-09-19T05:37:50.525715+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:37:50.525715+0000","last_undegraded":"2024-09-19T05:37:50.525715+0000","last_fullsized":"2024-09-19T05:37:50.525715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525756+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:37:50.525756+0000","last_peered":"2024-09-19T05:37:50.525756+0000","last_clean":"2024-09-19T05:37:50.525756+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:37:50.525756+0000","last_undegraded":"2024-09-19T05:37:50.525756+0000","last_fullsized":"2024-09-19T05:37:50.525756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830450+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:37:49.830450+0000","last_peered":"2024-09-19T05:37:49.830450+0000","last_clean":"2024-09-19T05:37:49.830450+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:37:49.830450+0000","last_undegraded":"2024-09-19T05:37:49.830450+0000","last_fullsized":"2024-09-19T05:37:49.830450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526998+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:37:50.526998+0000","last_peered":"2024-09-19T05:37:50.526998+0000","last_clean":"2024-09-19T05:37:50.526998+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:37:50.526998+0000","last_undegraded":"2024-09-19T05:37:50.526998+0000","last_fullsized":"2024-09-19T05:37:50.526998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836290+0000","last_change":"2024-09-19T05:37:43.798142+0000","last_active":"2024-09-19T05:37:49.836290+0000","last_peered":"2024-09-19T05:37:49.836290+0000","last_clean":"2024-09-19T05:37:49.836290+0000","last_became_active":"2024-09-19T05:37:43.797843+0000","last_became_peered":"2024-09-19T05:37:43.797843+0000","last_unstale":"2024-09-19T05:37:49.836290+0000","last_undegraded":"2024-09-19T05:37:49.836290+0000","last_fullsized":"2024-09-19T05:37:49.836290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:02.764951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836653+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:37:49.836653+0000","last_peered":"2024-09-19T05:37:49.836653+0000","last_clean":"2024-09-19T05:37:49.836653+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:37:49.836653+0000","last_undegraded":"2024-09-19T05:37:49.836653+0000","last_fullsized":"2024-09-19T05:37:49.836653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526498+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:37:50.526498+0000","last_peered":"2024-09-19T05:37:50.526498+0000","last_clean":"2024-09-19T05:37:50.526498+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:37:50.526498+0000","last_undegraded":"2024-09-19T05:37:50.526498+0000","last_fullsized":"2024-09-19T05:37:50.526498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525773+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:37:50.525773+0000","last_peered":"2024-09-19T05:37:50.525773+0000","last_clean":"2024-09-19T05:37:50.525773+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:37:50.525773+0000","last_undegraded":"2024-09-19T05:37:50.525773+0000","last_fullsized":"2024-09-19T05:37:50.525773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836622+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:37:49.836622+0000","last_peered":"2024-09-19T05:37:49.836622+0000","last_clean":"2024-09-19T05:37:49.836622+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:37:49.836622+0000","last_undegraded":"2024-09-19T05:37:49.836622+0000","last_fullsized":"2024-09-19T05:37:49.836622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525795+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:37:50.525795+0000","last_peered":"2024-09-19T05:37:50.525795+0000","last_clean":"2024-09-19T05:37:50.525795+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:37:50.525795+0000","last_undegraded":"2024-09-19T05:37:50.525795+0000","last_fullsized":"2024-09-19T05:37:50.525795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836111+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:37:49.836111+0000","last_peered":"2024-09-19T05:37:49.836111+0000","last_clean":"2024-09-19T05:37:49.836111+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:37:49.836111+0000","last_undegraded":"2024-09-19T05:37:49.836111+0000","last_fullsized":"2024-09-19T05:37:49.836111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525884+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:37:50.525884+0000","last_peered":"2024-09-19T05:37:50.525884+0000","last_clean":"2024-09-19T05:37:50.525884+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:37:50.525884+0000","last_undegraded":"2024-09-19T05:37:50.525884+0000","last_fullsized":"2024-09-19T05:37:50.525884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526777+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:37:50.526777+0000","last_peered":"2024-09-19T05:37:50.526777+0000","last_clean":"2024-09-19T05:37:50.526777+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:37:50.526777+0000","last_undegraded":"2024-09-19T05:37:50.526777+0000","last_fullsized":"2024-09-19T05:37:50.526777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526294+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:37:50.526294+0000","last_peered":"2024-09-19T05:37:50.526294+0000","last_clean":"2024-09-19T05:37:50.526294+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:37:50.526294+0000","last_undegraded":"2024-09-19T05:37:50.526294+0000","last_fullsized":"2024-09-19T05:37:50.526294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5376,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":703220,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":115470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":112298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":111662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":111536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":702542,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:14.704 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:14.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.837+0000 7f4ab3a1e640 1 Processor -- start 2024-09-19T05:38:14.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.837+0000 7f4ab3a1e640 1 -- start start 2024-09-19T05:38:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab3a1e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab3a1e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4aac0ccd60 0x7f4aac0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab3a1e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aac0cbea0 con 0x7f4aac15af20 2024-09-19T05:38:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab3a1e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f4aac0cb8f0 con 0x7f4aac0ccd60 2024-09-19T05:38:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab3a1e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac0cbbc0 con 0x7f4aac0cd380 2024-09-19T05:38:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab1fbb640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4aac15af20 0x7f4aac073340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50666/0 (socket says 172.21.15.103:50666) 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab1fbb640 1 -- 172.21.15.103:0/174982780 learned_addr learned my addr 172.21.15.103:0/174982780 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab17ba640 1 --2- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab0fb9640 1 --2- 172.21.15.103:0/174982780 >> v2:172.21.15.174:3300/0 conn(0x7f4aac0ccd60 0x7f4aac0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4aa3fff640 1 -- 172.21.15.103:0/174982780 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409230486 0 0) 0x7f4aac0cbea0 con 0x7f4aac15af20 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4aa3fff640 1 -- 172.21.15.103:0/174982780 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a98003520 con 0x7f4aac15af20 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4aa3fff640 1 -- 172.21.15.103:0/174982780 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4216214940 0 0) 0x7f4a98003520 con 0x7f4aac15af20 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab0fb9640 1 -- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 msgr2=0x7f4aac0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab0fb9640 1 --2- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac0cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab0fb9640 1 -- 172.21.15.103:0/174982780 >> v1:172.21.15.103:6789/0 conn(0x7f4aac15af20 legacy=0x7f4aac073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab0fb9640 1 -- 172.21.15.103:0/174982780 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac0c6780 con 0x7f4aac0ccd60 2024-09-19T05:38:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.838+0000 7f4ab17ba640 1 --2- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac0cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.839+0000 7f4ab0fb9640 1 --2- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac0ccd60 0x7f4aac0b4140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0097a0 tx=0x7f4a9c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb0a30fee8080778 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.839+0000 7f4aa3fff640 1 -- 172.21.15.103:0/174982780 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c037070 con 0x7f4aac0ccd60 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.839+0000 7f4aa3fff640 1 -- 172.21.15.103:0/174982780 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c02ac30 con 0x7f4aac0ccd60 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.839+0000 7f4aa3fff640 1 -- 172.21.15.103:0/174982780 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40019f0 con 0x7f4aac0ccd60 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac0ccd60 msgr2=0x7f4aac0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac0ccd60 0x7f4aac0b4140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0097a0 tx=0x7f4a9c02a1a0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/174982780 shutdown_connections 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac0ccd60 0x7f4aac0b4140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/174982780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac0cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/174982780 >> 172.21.15.103:0/174982780 conn(0x7f4aac06d830 msgr2=0x7f4aac06dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/174982780 shutdown_connections 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.840+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/174982780 wait complete. 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.841+0000 7f4ab3a1e640 1 Processor -- start 2024-09-19T05:38:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.841+0000 7f4ab3a1e640 1 -- start start 2024-09-19T05:38:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab3a1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aac0ccd60 0x7f4aac15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab3a1e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab3a1e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac15af20 0x7f4aac152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab3a1e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac0c7020 con 0x7f4aac0ccd60 2024-09-19T05:38:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab3a1e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac0c6d40 con 0x7f4aac15af20 2024-09-19T05:38:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab3a1e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac0b4680 con 0x7f4aac0cd380 2024-09-19T05:38:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aac0ccd60 0x7f4aac15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aac0ccd60 0x7f4aac15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56442/0 (socket says 172.21.15.103:56442) 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 -- 172.21.15.103:0/2849390147 learned_addr learned my addr 172.21.15.103:0/2849390147 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab0fb9640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab1fbb640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac15af20 0x7f4aac152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 -- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 msgr2=0x7f4aac152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 -- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac15af20 msgr2=0x7f4aac152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac15af20 0x7f4aac152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 -- 172.21.15.103:0/2849390147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac151f40 con 0x7f4aac0ccd60 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab0fb9640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab1fbb640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac15af20 0x7f4aac152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.842+0000 7f4ab17ba640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aac0ccd60 0x7f4aac15d200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800ebe0 tx=0x7f4aa800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.843+0000 7f4aa1ffb640 1 -- 172.21.15.103:0/2849390147 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8017070 con 0x7f4aac0ccd60 2024-09-19T05:38:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.843+0000 7f4aa1ffb640 1 -- 172.21.15.103:0/2849390147 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa800cc30 con 0x7f4aac0ccd60 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.843+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac15ddf0 con 0x7f4aac0ccd60 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.843+0000 7f4aa1ffb640 1 -- 172.21.15.103:0/2849390147 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8013470 con 0x7f4aac0ccd60 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.843+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac15c4b0 con 0x7f4aac0ccd60 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.844+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac1555e0 con 0x7f4aac0ccd60 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.844+0000 7f4aa1ffb640 1 -- 172.21.15.103:0/2849390147 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4aa801a070 con 0x7f4aac0ccd60 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.845+0000 7f4aa1ffb640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f4a9006c2b0 0x7f4a9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.845+0000 7f4aa1ffb640 1 -- 172.21.15.103:0/2849390147 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4aa808b9d0 con 0x7f4aac0ccd60 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.845+0000 7f4ab0fb9640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f4a9006c2b0 0x7f4a9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.845+0000 7f4ab0fb9640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f4a9006c2b0 0x7f4a9006e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c034000 tx=0x7f4a9c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:14.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:14.849+0000 7f4aa1ffb640 1 -- 172.21.15.103:0/2849390147 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4aac1555e0 con 0x7f4aac0ccd60 2024-09-19T05:38:15.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.014+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4aac151a80 con 0x7f4a9006c2b0 2024-09-19T05:38:15.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.022+0000 7f4aa1ffb640 1 -- 172.21.15.103:0/2849390147 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332714 (secure 0 0 0) 0x7f4aac151a80 con 0x7f4a9006c2b0 2024-09-19T05:38:15.027 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:15.029 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:38:15.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f4a9006c2b0 msgr2=0x7f4a9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f4a9006c2b0 0x7f4a9006e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c034000 tx=0x7f4a9c02e000 comp rx=0 tx=0).stop 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aac0ccd60 msgr2=0x7f4aac15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aac0ccd60 0x7f4aac15d200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800ebe0 tx=0x7f4aa800c520 comp rx=0 tx=0).stop 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 shutdown_connections 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f4a9006c2b0 0x7f4a9006e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4aac15af20 0x7f4aac152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4aac0cd380 0x7f4aac152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 --2- 172.21.15.103:0/2849390147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aac0ccd60 0x7f4aac15d200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 >> 172.21.15.103:0/2849390147 conn(0x7f4aac06d830 msgr2=0x7f4aac14db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 shutdown_connections 2024-09-19T05:38:15.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.025+0000 7f4ab3a1e640 1 -- 172.21.15.103:0/2849390147 wait complete. 2024-09-19T05:38:15.037 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-19T05:38:14.183369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595744,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":235,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218588,"kb_used_data":2372,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756132,"statfs":{"total":773094113280,"available":772870279168,"internally_reserved":0,"allocated":2428928,"data_stored":2084426,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":734,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003283"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526146+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:37:50.526146+0000","last_peered":"2024-09-19T05:37:50.526146+0000","last_clean":"2024-09-19T05:37:50.526146+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:37:50.526146+0000","last_undegraded":"2024-09-19T05:37:50.526146+0000","last_fullsized":"2024-09-19T05:37:50.526146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830894+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:37:49.830894+0000","last_peered":"2024-09-19T05:37:49.830894+0000","last_clean":"2024-09-19T05:37:49.830894+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:37:49.830894+0000","last_undegraded":"2024-09-19T05:37:49.830894+0000","last_fullsized":"2024-09-19T05:37:49.830894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830981+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:37:49.830981+0000","last_peered":"2024-09-19T05:37:49.830981+0000","last_clean":"2024-09-19T05:37:49.830981+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:37:49.830981+0000","last_undegraded":"2024-09-19T05:37:49.830981+0000","last_fullsized":"2024-09-19T05:37:49.830981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525978+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:37:50.525978+0000","last_peered":"2024-09-19T05:37:50.525978+0000","last_clean":"2024-09-19T05:37:50.525978+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:37:50.525978+0000","last_undegraded":"2024-09-19T05:37:50.525978+0000","last_fullsized":"2024-09-19T05:37:50.525978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525568+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:37:50.525568+0000","last_peered":"2024-09-19T05:37:50.525568+0000","last_clean":"2024-09-19T05:37:50.525568+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:37:50.525568+0000","last_undegraded":"2024-09-19T05:37:50.525568+0000","last_fullsized":"2024-09-19T05:37:50.525568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526316+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:37:50.526316+0000","last_peered":"2024-09-19T05:37:50.526316+0000","last_clean":"2024-09-19T05:37:50.526316+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:37:50.526316+0000","last_undegraded":"2024-09-19T05:37:50.526316+0000","last_fullsized":"2024-09-19T05:37:50.526316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836803+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:37:49.836803+0000","last_peered":"2024-09-19T05:37:49.836803+0000","last_clean":"2024-09-19T05:37:49.836803+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:37:49.836803+0000","last_undegraded":"2024-09-19T05:37:49.836803+0000","last_fullsized":"2024-09-19T05:37:49.836803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525961+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:37:50.525961+0000","last_peered":"2024-09-19T05:37:50.525961+0000","last_clean":"2024-09-19T05:37:50.525961+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:37:50.525961+0000","last_undegraded":"2024-09-19T05:37:50.525961+0000","last_fullsized":"2024-09-19T05:37:50.525961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526008+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:37:50.526008+0000","last_peered":"2024-09-19T05:37:50.526008+0000","last_clean":"2024-09-19T05:37:50.526008+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:37:50.526008+0000","last_undegraded":"2024-09-19T05:37:50.526008+0000","last_fullsized":"2024-09-19T05:37:50.526008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836489+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:37:49.836489+0000","last_peered":"2024-09-19T05:37:49.836489+0000","last_clean":"2024-09-19T05:37:49.836489+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:37:49.836489+0000","last_undegraded":"2024-09-19T05:37:49.836489+0000","last_fullsized":"2024-09-19T05:37:49.836489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526194+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:37:50.526194+0000","last_peered":"2024-09-19T05:37:50.526194+0000","last_clean":"2024-09-19T05:37:50.526194+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:37:50.526194+0000","last_undegraded":"2024-09-19T05:37:50.526194+0000","last_fullsized":"2024-09-19T05:37:50.526194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836393+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:37:49.836393+0000","last_peered":"2024-09-19T05:37:49.836393+0000","last_clean":"2024-09-19T05:37:49.836393+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:37:49.836393+0000","last_undegraded":"2024-09-19T05:37:49.836393+0000","last_fullsized":"2024-09-19T05:37:49.836393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.886661+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:38:10.886661+0000","last_peered":"2024-09-19T05:38:10.886661+0000","last_clean":"2024-09-19T05:38:10.886661+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:38:10.886661+0000","last_undegraded":"2024-09-19T05:38:10.886661+0000","last_fullsized":"2024-09-19T05:38:10.886661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527273+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:37:50.527273+0000","last_peered":"2024-09-19T05:37:50.527273+0000","last_clean":"2024-09-19T05:37:50.527273+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:37:50.527273+0000","last_undegraded":"2024-09-19T05:37:50.527273+0000","last_fullsized":"2024-09-19T05:37:50.527273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830473+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:37:49.830473+0000","last_peered":"2024-09-19T05:37:49.830473+0000","last_clean":"2024-09-19T05:37:49.830473+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:37:49.830473+0000","last_undegraded":"2024-09-19T05:37:49.830473+0000","last_fullsized":"2024-09-19T05:37:49.830473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526715+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:37:50.526715+0000","last_peered":"2024-09-19T05:37:50.526715+0000","last_clean":"2024-09-19T05:37:50.526715+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:37:50.526715+0000","last_undegraded":"2024-09-19T05:37:50.526715+0000","last_fullsized":"2024-09-19T05:37:50.526715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526929+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:37:50.526929+0000","last_peered":"2024-09-19T05:37:50.526929+0000","last_clean":"2024-09-19T05:37:50.526929+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:37:50.526929+0000","last_undegraded":"2024-09-19T05:37:50.526929+0000","last_fullsized":"2024-09-19T05:37:50.526929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830185+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:37:49.830185+0000","last_peered":"2024-09-19T05:37:49.830185+0000","last_clean":"2024-09-19T05:37:49.830185+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:37:49.830185+0000","last_undegraded":"2024-09-19T05:37:49.830185+0000","last_fullsized":"2024-09-19T05:37:49.830185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525802+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:37:50.525802+0000","last_peered":"2024-09-19T05:37:50.525802+0000","last_clean":"2024-09-19T05:37:50.525802+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:37:50.525802+0000","last_undegraded":"2024-09-19T05:37:50.525802+0000","last_fullsized":"2024-09-19T05:37:50.525802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526964+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:37:50.526964+0000","last_peered":"2024-09-19T05:37:50.526964+0000","last_clean":"2024-09-19T05:37:50.526964+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:37:50.526964+0000","last_undegraded":"2024-09-19T05:37:50.526964+0000","last_fullsized":"2024-09-19T05:37:50.526964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526748+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:37:50.526748+0000","last_peered":"2024-09-19T05:37:50.526748+0000","last_clean":"2024-09-19T05:37:50.526748+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:37:50.526748+0000","last_undegraded":"2024-09-19T05:37:50.526748+0000","last_fullsized":"2024-09-19T05:37:50.526748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.885103+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:10.885103+0000","last_peered":"2024-09-19T05:38:10.885103+0000","last_clean":"2024-09-19T05:38:10.885103+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:10.885103+0000","last_undegraded":"2024-09-19T05:38:10.885103+0000","last_fullsized":"2024-09-19T05:38:10.885103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526205+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:37:50.526205+0000","last_peered":"2024-09-19T05:37:50.526205+0000","last_clean":"2024-09-19T05:37:50.526205+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:37:50.526205+0000","last_undegraded":"2024-09-19T05:37:50.526205+0000","last_fullsized":"2024-09-19T05:37:50.526205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526013+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:37:50.526013+0000","last_peered":"2024-09-19T05:37:50.526013+0000","last_clean":"2024-09-19T05:37:50.526013+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:37:50.526013+0000","last_undegraded":"2024-09-19T05:37:50.526013+0000","last_fullsized":"2024-09-19T05:37:50.526013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.883920+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:38:10.883920+0000","last_peered":"2024-09-19T05:38:10.883920+0000","last_clean":"2024-09-19T05:38:10.883920+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:38:10.883920+0000","last_undegraded":"2024-09-19T05:38:10.883920+0000","last_fullsized":"2024-09-19T05:38:10.883920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526592+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:37:50.526592+0000","last_peered":"2024-09-19T05:37:50.526592+0000","last_clean":"2024-09-19T05:37:50.526592+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:37:50.526592+0000","last_undegraded":"2024-09-19T05:37:50.526592+0000","last_fullsized":"2024-09-19T05:37:50.526592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830955+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:37:49.830955+0000","last_peered":"2024-09-19T05:37:49.830955+0000","last_clean":"2024-09-19T05:37:49.830955+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:37:49.830955+0000","last_undegraded":"2024-09-19T05:37:49.830955+0000","last_fullsized":"2024-09-19T05:37:49.830955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526862+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:37:50.526862+0000","last_peered":"2024-09-19T05:37:50.526862+0000","last_clean":"2024-09-19T05:37:50.526862+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:37:50.526862+0000","last_undegraded":"2024-09-19T05:37:50.526862+0000","last_fullsized":"2024-09-19T05:37:50.526862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829936+0000","last_change":"2024-09-19T05:37:48.360604+0000","last_active":"2024-09-19T05:37:49.829936+0000","last_peered":"2024-09-19T05:37:49.829936+0000","last_clean":"2024-09-19T05:37:49.829936+0000","last_became_active":"2024-09-19T05:37:48.360142+0000","last_became_peered":"2024-09-19T05:37:48.360142+0000","last_unstale":"2024-09-19T05:37:49.829936+0000","last_undegraded":"2024-09-19T05:37:49.829936+0000","last_fullsized":"2024-09-19T05:37:49.829936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:52.762613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526855+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:37:50.526855+0000","last_peered":"2024-09-19T05:37:50.526855+0000","last_clean":"2024-09-19T05:37:50.526855+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:37:50.526855+0000","last_undegraded":"2024-09-19T05:37:50.526855+0000","last_fullsized":"2024-09-19T05:37:50.526855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526665+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:37:50.526665+0000","last_peered":"2024-09-19T05:37:50.526665+0000","last_clean":"2024-09-19T05:37:50.526665+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:37:50.526665+0000","last_undegraded":"2024-09-19T05:37:50.526665+0000","last_fullsized":"2024-09-19T05:37:50.526665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526178+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:37:50.526178+0000","last_peered":"2024-09-19T05:37:50.526178+0000","last_clean":"2024-09-19T05:37:50.526178+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:37:50.526178+0000","last_undegraded":"2024-09-19T05:37:50.526178+0000","last_fullsized":"2024-09-19T05:37:50.526178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836580+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:37:49.836580+0000","last_peered":"2024-09-19T05:37:49.836580+0000","last_clean":"2024-09-19T05:37:49.836580+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:37:49.836580+0000","last_undegraded":"2024-09-19T05:37:49.836580+0000","last_fullsized":"2024-09-19T05:37:49.836580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526879+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:37:50.526879+0000","last_peered":"2024-09-19T05:37:50.526879+0000","last_clean":"2024-09-19T05:37:50.526879+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:37:50.526879+0000","last_undegraded":"2024-09-19T05:37:50.526879+0000","last_fullsized":"2024-09-19T05:37:50.526879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526516+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:37:50.526516+0000","last_peered":"2024-09-19T05:37:50.526516+0000","last_clean":"2024-09-19T05:37:50.526516+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:37:50.526516+0000","last_undegraded":"2024-09-19T05:37:50.526516+0000","last_fullsized":"2024-09-19T05:37:50.526516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526515+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:37:50.526515+0000","last_peered":"2024-09-19T05:37:50.526515+0000","last_clean":"2024-09-19T05:37:50.526515+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:37:50.526515+0000","last_undegraded":"2024-09-19T05:37:50.526515+0000","last_fullsized":"2024-09-19T05:37:50.526515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836809+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:37:49.836809+0000","last_peered":"2024-09-19T05:37:49.836809+0000","last_clean":"2024-09-19T05:37:49.836809+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:37:49.836809+0000","last_undegraded":"2024-09-19T05:37:49.836809+0000","last_fullsized":"2024-09-19T05:37:49.836809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526796+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:37:50.526796+0000","last_peered":"2024-09-19T05:37:50.526796+0000","last_clean":"2024-09-19T05:37:50.526796+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:37:50.526796+0000","last_undegraded":"2024-09-19T05:37:50.526796+0000","last_fullsized":"2024-09-19T05:37:50.526796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525410+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:37:50.525410+0000","last_peered":"2024-09-19T05:37:50.525410+0000","last_clean":"2024-09-19T05:37:50.525410+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:37:50.525410+0000","last_undegraded":"2024-09-19T05:37:50.525410+0000","last_fullsized":"2024-09-19T05:37:50.525410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525365+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:37:50.525365+0000","last_peered":"2024-09-19T05:37:50.525365+0000","last_clean":"2024-09-19T05:37:50.525365+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:37:50.525365+0000","last_undegraded":"2024-09-19T05:37:50.525365+0000","last_fullsized":"2024-09-19T05:37:50.525365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526961+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:37:50.526961+0000","last_peered":"2024-09-19T05:37:50.526961+0000","last_clean":"2024-09-19T05:37:50.526961+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:37:50.526961+0000","last_undegraded":"2024-09-19T05:37:50.526961+0000","last_fullsized":"2024-09-19T05:37:50.526961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525663+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:37:50.525663+0000","last_peered":"2024-09-19T05:37:50.525663+0000","last_clean":"2024-09-19T05:37:50.525663+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:37:50.525663+0000","last_undegraded":"2024-09-19T05:37:50.525663+0000","last_fullsized":"2024-09-19T05:37:50.525663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525558+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:37:50.525558+0000","last_peered":"2024-09-19T05:37:50.525558+0000","last_clean":"2024-09-19T05:37:50.525558+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:37:50.525558+0000","last_undegraded":"2024-09-19T05:37:50.525558+0000","last_fullsized":"2024-09-19T05:37:50.525558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525931+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:37:50.525931+0000","last_peered":"2024-09-19T05:37:50.525931+0000","last_clean":"2024-09-19T05:37:50.525931+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:37:50.525931+0000","last_undegraded":"2024-09-19T05:37:50.525931+0000","last_fullsized":"2024-09-19T05:37:50.525931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830243+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:37:49.830243+0000","last_peered":"2024-09-19T05:37:49.830243+0000","last_clean":"2024-09-19T05:37:49.830243+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:37:49.830243+0000","last_undegraded":"2024-09-19T05:37:49.830243+0000","last_fullsized":"2024-09-19T05:37:49.830243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.885935+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:10.885935+0000","last_peered":"2024-09-19T05:38:10.885935+0000","last_clean":"2024-09-19T05:38:10.885935+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:10.885935+0000","last_undegraded":"2024-09-19T05:38:10.885935+0000","last_fullsized":"2024-09-19T05:38:10.885935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525629+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:37:50.525629+0000","last_peered":"2024-09-19T05:37:50.525629+0000","last_clean":"2024-09-19T05:37:50.525629+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:37:50.525629+0000","last_undegraded":"2024-09-19T05:37:50.525629+0000","last_fullsized":"2024-09-19T05:37:50.525629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836135+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:37:49.836135+0000","last_peered":"2024-09-19T05:37:49.836135+0000","last_clean":"2024-09-19T05:37:49.836135+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:37:49.836135+0000","last_undegraded":"2024-09-19T05:37:49.836135+0000","last_fullsized":"2024-09-19T05:37:49.836135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526130+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:37:50.526130+0000","last_peered":"2024-09-19T05:37:50.526130+0000","last_clean":"2024-09-19T05:37:50.526130+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:37:50.526130+0000","last_undegraded":"2024-09-19T05:37:50.526130+0000","last_fullsized":"2024-09-19T05:37:50.526130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525763+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:37:50.525763+0000","last_peered":"2024-09-19T05:37:50.525763+0000","last_clean":"2024-09-19T05:37:50.525763+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:37:50.525763+0000","last_undegraded":"2024-09-19T05:37:50.525763+0000","last_fullsized":"2024-09-19T05:37:50.525763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836366+0000","last_change":"2024-09-19T05:37:48.360455+0000","last_active":"2024-09-19T05:37:49.836366+0000","last_peered":"2024-09-19T05:37:49.836366+0000","last_clean":"2024-09-19T05:37:49.836366+0000","last_became_active":"2024-09-19T05:37:48.360015+0000","last_became_peered":"2024-09-19T05:37:48.360015+0000","last_unstale":"2024-09-19T05:37:49.836366+0000","last_undegraded":"2024-09-19T05:37:49.836366+0000","last_fullsized":"2024-09-19T05:37:49.836366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:58.281260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836248+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:37:49.836248+0000","last_peered":"2024-09-19T05:37:49.836248+0000","last_clean":"2024-09-19T05:37:49.836248+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:37:49.836248+0000","last_undegraded":"2024-09-19T05:37:49.836248+0000","last_fullsized":"2024-09-19T05:37:49.836248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526377+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:37:50.526377+0000","last_peered":"2024-09-19T05:37:50.526377+0000","last_clean":"2024-09-19T05:37:50.526377+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:37:50.526377+0000","last_undegraded":"2024-09-19T05:37:50.526377+0000","last_fullsized":"2024-09-19T05:37:50.526377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526335+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:37:50.526335+0000","last_peered":"2024-09-19T05:37:50.526335+0000","last_clean":"2024-09-19T05:37:50.526335+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:37:50.526335+0000","last_undegraded":"2024-09-19T05:37:50.526335+0000","last_fullsized":"2024-09-19T05:37:50.526335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526501+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:37:50.526501+0000","last_peered":"2024-09-19T05:37:50.526501+0000","last_clean":"2024-09-19T05:37:50.526501+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:37:50.526501+0000","last_undegraded":"2024-09-19T05:37:50.526501+0000","last_fullsized":"2024-09-19T05:37:50.526501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525419+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:37:50.525419+0000","last_peered":"2024-09-19T05:37:50.525419+0000","last_clean":"2024-09-19T05:37:50.525419+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:37:50.525419+0000","last_undegraded":"2024-09-19T05:37:50.525419+0000","last_fullsized":"2024-09-19T05:37:50.525419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835474+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:37:49.835474+0000","last_peered":"2024-09-19T05:37:49.835474+0000","last_clean":"2024-09-19T05:37:49.835474+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:37:49.835474+0000","last_undegraded":"2024-09-19T05:37:49.835474+0000","last_fullsized":"2024-09-19T05:37:49.835474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526347+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:37:50.526347+0000","last_peered":"2024-09-19T05:37:50.526347+0000","last_clean":"2024-09-19T05:37:50.526347+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:37:50.526347+0000","last_undegraded":"2024-09-19T05:37:50.526347+0000","last_fullsized":"2024-09-19T05:37:50.526347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526647+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:37:50.526647+0000","last_peered":"2024-09-19T05:37:50.526647+0000","last_clean":"2024-09-19T05:37:50.526647+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:37:50.526647+0000","last_undegraded":"2024-09-19T05:37:50.526647+0000","last_fullsized":"2024-09-19T05:37:50.526647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525843+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:37:50.525843+0000","last_peered":"2024-09-19T05:37:50.525843+0000","last_clean":"2024-09-19T05:37:50.525843+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:37:50.525843+0000","last_undegraded":"2024-09-19T05:37:50.525843+0000","last_fullsized":"2024-09-19T05:37:50.525843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525805+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:37:50.525805+0000","last_peered":"2024-09-19T05:37:50.525805+0000","last_clean":"2024-09-19T05:37:50.525805+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:37:50.525805+0000","last_undegraded":"2024-09-19T05:37:50.525805+0000","last_fullsized":"2024-09-19T05:37:50.525805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525050+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:37:50.525050+0000","last_peered":"2024-09-19T05:37:50.525050+0000","last_clean":"2024-09-19T05:37:50.525050+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:37:50.525050+0000","last_undegraded":"2024-09-19T05:37:50.525050+0000","last_fullsized":"2024-09-19T05:37:50.525050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525789+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:37:50.525789+0000","last_peered":"2024-09-19T05:37:50.525789+0000","last_clean":"2024-09-19T05:37:50.525789+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:37:50.525789+0000","last_undegraded":"2024-09-19T05:37:50.525789+0000","last_fullsized":"2024-09-19T05:37:50.525789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836113+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:37:49.836113+0000","last_peered":"2024-09-19T05:37:49.836113+0000","last_clean":"2024-09-19T05:37:49.836113+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:37:49.836113+0000","last_undegraded":"2024-09-19T05:37:49.836113+0000","last_fullsized":"2024-09-19T05:37:49.836113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836182+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:37:49.836182+0000","last_peered":"2024-09-19T05:37:49.836182+0000","last_clean":"2024-09-19T05:37:49.836182+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:37:49.836182+0000","last_undegraded":"2024-09-19T05:37:49.836182+0000","last_fullsized":"2024-09-19T05:37:49.836182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830874+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:37:49.830874+0000","last_peered":"2024-09-19T05:37:49.830874+0000","last_clean":"2024-09-19T05:37:49.830874+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:37:49.830874+0000","last_undegraded":"2024-09-19T05:37:49.830874+0000","last_fullsized":"2024-09-19T05:37:49.830874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525857+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:37:50.525857+0000","last_peered":"2024-09-19T05:37:50.525857+0000","last_clean":"2024-09-19T05:37:50.525857+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:37:50.525857+0000","last_undegraded":"2024-09-19T05:37:50.525857+0000","last_fullsized":"2024-09-19T05:37:50.525857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.885755+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:38:10.885755+0000","last_peered":"2024-09-19T05:38:10.885755+0000","last_clean":"2024-09-19T05:38:10.885755+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:38:10.885755+0000","last_undegraded":"2024-09-19T05:38:10.885755+0000","last_fullsized":"2024-09-19T05:38:10.885755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830313+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:37:49.830313+0000","last_peered":"2024-09-19T05:37:49.830313+0000","last_clean":"2024-09-19T05:37:49.830313+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:37:49.830313+0000","last_undegraded":"2024-09-19T05:37:49.830313+0000","last_fullsized":"2024-09-19T05:37:49.830313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525852+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:37:50.525852+0000","last_peered":"2024-09-19T05:37:50.525852+0000","last_clean":"2024-09-19T05:37:50.525852+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:37:50.525852+0000","last_undegraded":"2024-09-19T05:37:50.525852+0000","last_fullsized":"2024-09-19T05:37:50.525852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526451+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:37:50.526451+0000","last_peered":"2024-09-19T05:37:50.526451+0000","last_clean":"2024-09-19T05:37:50.526451+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:37:50.526451+0000","last_undegraded":"2024-09-19T05:37:50.526451+0000","last_fullsized":"2024-09-19T05:37:50.526451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836390+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:37:49.836390+0000","last_peered":"2024-09-19T05:37:49.836390+0000","last_clean":"2024-09-19T05:37:49.836390+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:37:49.836390+0000","last_undegraded":"2024-09-19T05:37:49.836390+0000","last_fullsized":"2024-09-19T05:37:49.836390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526036+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:37:50.526036+0000","last_peered":"2024-09-19T05:37:50.526036+0000","last_clean":"2024-09-19T05:37:50.526036+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:37:50.526036+0000","last_undegraded":"2024-09-19T05:37:50.526036+0000","last_fullsized":"2024-09-19T05:37:50.526036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.884330+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:38:10.884330+0000","last_peered":"2024-09-19T05:38:10.884330+0000","last_clean":"2024-09-19T05:38:10.884330+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:38:10.884330+0000","last_undegraded":"2024-09-19T05:38:10.884330+0000","last_fullsized":"2024-09-19T05:38:10.884330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526654+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:37:50.526654+0000","last_peered":"2024-09-19T05:37:50.526654+0000","last_clean":"2024-09-19T05:37:50.526654+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:37:50.526654+0000","last_undegraded":"2024-09-19T05:37:50.526654+0000","last_fullsized":"2024-09-19T05:37:50.526654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.527026+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:37:50.527026+0000","last_peered":"2024-09-19T05:37:50.527026+0000","last_clean":"2024-09-19T05:37:50.527026+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:37:50.527026+0000","last_undegraded":"2024-09-19T05:37:50.527026+0000","last_fullsized":"2024-09-19T05:37:50.527026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526407+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:37:50.526407+0000","last_peered":"2024-09-19T05:37:50.526407+0000","last_clean":"2024-09-19T05:37:50.526407+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:37:50.526407+0000","last_undegraded":"2024-09-19T05:37:50.526407+0000","last_fullsized":"2024-09-19T05:37:50.526407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526199+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:37:50.526199+0000","last_peered":"2024-09-19T05:37:50.526199+0000","last_clean":"2024-09-19T05:37:50.526199+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:37:50.526199+0000","last_undegraded":"2024-09-19T05:37:50.526199+0000","last_fullsized":"2024-09-19T05:37:50.526199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526059+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:37:50.526059+0000","last_peered":"2024-09-19T05:37:50.526059+0000","last_clean":"2024-09-19T05:37:50.526059+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:37:50.526059+0000","last_undegraded":"2024-09-19T05:37:50.526059+0000","last_fullsized":"2024-09-19T05:37:50.526059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.889572+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:10.889572+0000","last_peered":"2024-09-19T05:38:10.889572+0000","last_clean":"2024-09-19T05:38:10.889572+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:10.889572+0000","last_undegraded":"2024-09-19T05:38:10.889572+0000","last_fullsized":"2024-09-19T05:38:10.889572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830099+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:37:49.830099+0000","last_peered":"2024-09-19T05:37:49.830099+0000","last_clean":"2024-09-19T05:37:49.830099+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:37:49.830099+0000","last_undegraded":"2024-09-19T05:37:49.830099+0000","last_fullsized":"2024-09-19T05:37:49.830099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836270+0000","last_change":"2024-09-19T05:37:43.798426+0000","last_active":"2024-09-19T05:37:49.836270+0000","last_peered":"2024-09-19T05:37:49.836270+0000","last_clean":"2024-09-19T05:37:49.836270+0000","last_became_active":"2024-09-19T05:37:43.797575+0000","last_became_peered":"2024-09-19T05:37:43.797575+0000","last_unstale":"2024-09-19T05:37:49.836270+0000","last_undegraded":"2024-09-19T05:37:49.836270+0000","last_fullsized":"2024-09-19T05:37:49.836270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:07.139397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.886259+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:38:10.886259+0000","last_peered":"2024-09-19T05:38:10.886259+0000","last_clean":"2024-09-19T05:38:10.886259+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:38:10.886259+0000","last_undegraded":"2024-09-19T05:38:10.886259+0000","last_fullsized":"2024-09-19T05:38:10.886259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830059+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:37:49.830059+0000","last_peered":"2024-09-19T05:37:49.830059+0000","last_clean":"2024-09-19T05:37:49.830059+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:37:49.830059+0000","last_undegraded":"2024-09-19T05:37:49.830059+0000","last_fullsized":"2024-09-19T05:37:49.830059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525638+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:37:50.525638+0000","last_peered":"2024-09-19T05:37:50.525638+0000","last_clean":"2024-09-19T05:37:50.525638+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:37:50.525638+0000","last_undegraded":"2024-09-19T05:37:50.525638+0000","last_fullsized":"2024-09-19T05:37:50.525638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525626+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:37:50.525626+0000","last_peered":"2024-09-19T05:37:50.525626+0000","last_clean":"2024-09-19T05:37:50.525626+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:37:50.525626+0000","last_undegraded":"2024-09-19T05:37:50.525626+0000","last_fullsized":"2024-09-19T05:37:50.525626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836280+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:37:49.836280+0000","last_peered":"2024-09-19T05:37:49.836280+0000","last_clean":"2024-09-19T05:37:49.836280+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:37:49.836280+0000","last_undegraded":"2024-09-19T05:37:49.836280+0000","last_fullsized":"2024-09-19T05:37:49.836280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836846+0000","last_change":"2024-09-19T05:37:47.808596+0000","last_active":"2024-09-19T05:37:49.836846+0000","last_peered":"2024-09-19T05:37:49.836846+0000","last_clean":"2024-09-19T05:37:49.836846+0000","last_became_active":"2024-09-19T05:37:47.808169+0000","last_became_peered":"2024-09-19T05:37:47.808169+0000","last_unstale":"2024-09-19T05:37:49.836846+0000","last_undegraded":"2024-09-19T05:37:49.836846+0000","last_fullsized":"2024-09-19T05:37:49.836846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:44.137286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830088+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:37:49.830088+0000","last_peered":"2024-09-19T05:37:49.830088+0000","last_clean":"2024-09-19T05:37:49.830088+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:37:49.830088+0000","last_undegraded":"2024-09-19T05:37:49.830088+0000","last_fullsized":"2024-09-19T05:37:49.830088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830275+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:37:49.830275+0000","last_peered":"2024-09-19T05:37:49.830275+0000","last_clean":"2024-09-19T05:37:49.830275+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:37:49.830275+0000","last_undegraded":"2024-09-19T05:37:49.830275+0000","last_fullsized":"2024-09-19T05:37:49.830275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836491+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:37:49.836491+0000","last_peered":"2024-09-19T05:37:49.836491+0000","last_clean":"2024-09-19T05:37:49.836491+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:37:49.836491+0000","last_undegraded":"2024-09-19T05:37:49.836491+0000","last_fullsized":"2024-09-19T05:37:49.836491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526741+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:37:50.526741+0000","last_peered":"2024-09-19T05:37:50.526741+0000","last_clean":"2024-09-19T05:37:50.526741+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:37:50.526741+0000","last_undegraded":"2024-09-19T05:37:50.526741+0000","last_fullsized":"2024-09-19T05:37:50.526741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525558+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:37:50.525558+0000","last_peered":"2024-09-19T05:37:50.525558+0000","last_clean":"2024-09-19T05:37:50.525558+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:37:50.525558+0000","last_undegraded":"2024-09-19T05:37:50.525558+0000","last_fullsized":"2024-09-19T05:37:50.525558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:38:10.890234+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:38:10.890234+0000","last_peered":"2024-09-19T05:38:10.890234+0000","last_clean":"2024-09-19T05:38:10.890234+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:38:10.890234+0000","last_undegraded":"2024-09-19T05:38:10.890234+0000","last_fullsized":"2024-09-19T05:38:10.890234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526434+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:37:50.526434+0000","last_peered":"2024-09-19T05:37:50.526434+0000","last_clean":"2024-09-19T05:37:50.526434+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:37:50.526434+0000","last_undegraded":"2024-09-19T05:37:50.526434+0000","last_fullsized":"2024-09-19T05:37:50.526434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830768+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:37:49.830768+0000","last_peered":"2024-09-19T05:37:49.830768+0000","last_clean":"2024-09-19T05:37:49.830768+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:37:49.830768+0000","last_undegraded":"2024-09-19T05:37:49.830768+0000","last_fullsized":"2024-09-19T05:37:49.830768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835869+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:37:49.835869+0000","last_peered":"2024-09-19T05:37:49.835869+0000","last_clean":"2024-09-19T05:37:49.835869+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:37:49.835869+0000","last_undegraded":"2024-09-19T05:37:49.835869+0000","last_fullsized":"2024-09-19T05:37:49.835869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525234+0000","last_change":"2024-09-19T05:37:43.791626+0000","last_active":"2024-09-19T05:37:50.525234+0000","last_peered":"2024-09-19T05:37:50.525234+0000","last_clean":"2024-09-19T05:37:50.525234+0000","last_became_active":"2024-09-19T05:37:43.791176+0000","last_became_peered":"2024-09-19T05:37:43.791176+0000","last_unstale":"2024-09-19T05:37:50.525234+0000","last_undegraded":"2024-09-19T05:37:50.525234+0000","last_fullsized":"2024-09-19T05:37:50.525234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:30.947341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836714+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:37:49.836714+0000","last_peered":"2024-09-19T05:37:49.836714+0000","last_clean":"2024-09-19T05:37:49.836714+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:37:49.836714+0000","last_undegraded":"2024-09-19T05:37:49.836714+0000","last_fullsized":"2024-09-19T05:37:49.836714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526338+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:37:50.526338+0000","last_peered":"2024-09-19T05:37:50.526338+0000","last_clean":"2024-09-19T05:37:50.526338+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:37:50.526338+0000","last_undegraded":"2024-09-19T05:37:50.526338+0000","last_fullsized":"2024-09-19T05:37:50.526338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830471+0000","last_change":"2024-09-19T05:37:43.795638+0000","last_active":"2024-09-19T05:37:49.830471+0000","last_peered":"2024-09-19T05:37:49.830471+0000","last_clean":"2024-09-19T05:37:49.830471+0000","last_became_active":"2024-09-19T05:37:43.795360+0000","last_became_peered":"2024-09-19T05:37:43.795360+0000","last_unstale":"2024-09-19T05:37:49.830471+0000","last_undegraded":"2024-09-19T05:37:49.830471+0000","last_fullsized":"2024-09-19T05:37:49.830471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:44:08.525535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526265+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:37:50.526265+0000","last_peered":"2024-09-19T05:37:50.526265+0000","last_clean":"2024-09-19T05:37:50.526265+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:37:50.526265+0000","last_undegraded":"2024-09-19T05:37:50.526265+0000","last_fullsized":"2024-09-19T05:37:50.526265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836748+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:37:49.836748+0000","last_peered":"2024-09-19T05:37:49.836748+0000","last_clean":"2024-09-19T05:37:49.836748+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:37:49.836748+0000","last_undegraded":"2024-09-19T05:37:49.836748+0000","last_fullsized":"2024-09-19T05:37:49.836748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830871+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:37:49.830871+0000","last_peered":"2024-09-19T05:37:49.830871+0000","last_clean":"2024-09-19T05:37:49.830871+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:37:49.830871+0000","last_undegraded":"2024-09-19T05:37:49.830871+0000","last_fullsized":"2024-09-19T05:37:49.830871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835569+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:37:49.835569+0000","last_peered":"2024-09-19T05:37:49.835569+0000","last_clean":"2024-09-19T05:37:49.835569+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:37:49.835569+0000","last_undegraded":"2024-09-19T05:37:49.835569+0000","last_fullsized":"2024-09-19T05:37:49.835569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830198+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:37:49.830198+0000","last_peered":"2024-09-19T05:37:49.830198+0000","last_clean":"2024-09-19T05:37:49.830198+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:37:49.830198+0000","last_undegraded":"2024-09-19T05:37:49.830198+0000","last_fullsized":"2024-09-19T05:37:49.830198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836658+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:37:49.836658+0000","last_peered":"2024-09-19T05:37:49.836658+0000","last_clean":"2024-09-19T05:37:49.836658+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:37:49.836658+0000","last_undegraded":"2024-09-19T05:37:49.836658+0000","last_fullsized":"2024-09-19T05:37:49.836658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526251+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:37:50.526251+0000","last_peered":"2024-09-19T05:37:50.526251+0000","last_clean":"2024-09-19T05:37:50.526251+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:37:50.526251+0000","last_undegraded":"2024-09-19T05:37:50.526251+0000","last_fullsized":"2024-09-19T05:37:50.526251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836668+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:37:49.836668+0000","last_peered":"2024-09-19T05:37:49.836668+0000","last_clean":"2024-09-19T05:37:49.836668+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:37:49.836668+0000","last_undegraded":"2024-09-19T05:37:49.836668+0000","last_fullsized":"2024-09-19T05:37:49.836668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526418+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:37:50.526418+0000","last_peered":"2024-09-19T05:37:50.526418+0000","last_clean":"2024-09-19T05:37:50.526418+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:37:50.526418+0000","last_undegraded":"2024-09-19T05:37:50.526418+0000","last_fullsized":"2024-09-19T05:37:50.526418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525330+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:37:50.525330+0000","last_peered":"2024-09-19T05:37:50.525330+0000","last_clean":"2024-09-19T05:37:50.525330+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:37:50.525330+0000","last_undegraded":"2024-09-19T05:37:50.525330+0000","last_fullsized":"2024-09-19T05:37:50.525330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836515+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:37:49.836515+0000","last_peered":"2024-09-19T05:37:49.836515+0000","last_clean":"2024-09-19T05:37:49.836515+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:37:49.836515+0000","last_undegraded":"2024-09-19T05:37:49.836515+0000","last_fullsized":"2024-09-19T05:37:49.836515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.835454+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:37:49.835454+0000","last_peered":"2024-09-19T05:37:49.835454+0000","last_clean":"2024-09-19T05:37:49.835454+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:37:49.835454+0000","last_undegraded":"2024-09-19T05:37:49.835454+0000","last_fullsized":"2024-09-19T05:37:49.835454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525715+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:37:50.525715+0000","last_peered":"2024-09-19T05:37:50.525715+0000","last_clean":"2024-09-19T05:37:50.525715+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:37:50.525715+0000","last_undegraded":"2024-09-19T05:37:50.525715+0000","last_fullsized":"2024-09-19T05:37:50.525715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525756+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:37:50.525756+0000","last_peered":"2024-09-19T05:37:50.525756+0000","last_clean":"2024-09-19T05:37:50.525756+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:37:50.525756+0000","last_undegraded":"2024-09-19T05:37:50.525756+0000","last_fullsized":"2024-09-19T05:37:50.525756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.830450+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:37:49.830450+0000","last_peered":"2024-09-19T05:37:49.830450+0000","last_clean":"2024-09-19T05:37:49.830450+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:37:49.830450+0000","last_undegraded":"2024-09-19T05:37:49.830450+0000","last_fullsized":"2024-09-19T05:37:49.830450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526998+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:37:50.526998+0000","last_peered":"2024-09-19T05:37:50.526998+0000","last_clean":"2024-09-19T05:37:50.526998+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:37:50.526998+0000","last_undegraded":"2024-09-19T05:37:50.526998+0000","last_fullsized":"2024-09-19T05:37:50.526998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836290+0000","last_change":"2024-09-19T05:37:43.798142+0000","last_active":"2024-09-19T05:37:49.836290+0000","last_peered":"2024-09-19T05:37:49.836290+0000","last_clean":"2024-09-19T05:37:49.836290+0000","last_became_active":"2024-09-19T05:37:43.797843+0000","last_became_peered":"2024-09-19T05:37:43.797843+0000","last_unstale":"2024-09-19T05:37:49.836290+0000","last_undegraded":"2024-09-19T05:37:49.836290+0000","last_fullsized":"2024-09-19T05:37:49.836290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:02.764951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836653+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:37:49.836653+0000","last_peered":"2024-09-19T05:37:49.836653+0000","last_clean":"2024-09-19T05:37:49.836653+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:37:49.836653+0000","last_undegraded":"2024-09-19T05:37:49.836653+0000","last_fullsized":"2024-09-19T05:37:49.836653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526498+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:37:50.526498+0000","last_peered":"2024-09-19T05:37:50.526498+0000","last_clean":"2024-09-19T05:37:50.526498+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:37:50.526498+0000","last_undegraded":"2024-09-19T05:37:50.526498+0000","last_fullsized":"2024-09-19T05:37:50.526498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.829992+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:37:49.829992+0000","last_peered":"2024-09-19T05:37:49.829992+0000","last_clean":"2024-09-19T05:37:49.829992+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:37:49.829992+0000","last_undegraded":"2024-09-19T05:37:49.829992+0000","last_fullsized":"2024-09-19T05:37:49.829992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525773+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:37:50.525773+0000","last_peered":"2024-09-19T05:37:50.525773+0000","last_clean":"2024-09-19T05:37:50.525773+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:37:50.525773+0000","last_undegraded":"2024-09-19T05:37:50.525773+0000","last_fullsized":"2024-09-19T05:37:50.525773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836622+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:37:49.836622+0000","last_peered":"2024-09-19T05:37:49.836622+0000","last_clean":"2024-09-19T05:37:49.836622+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:37:49.836622+0000","last_undegraded":"2024-09-19T05:37:49.836622+0000","last_fullsized":"2024-09-19T05:37:49.836622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525795+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:37:50.525795+0000","last_peered":"2024-09-19T05:37:50.525795+0000","last_clean":"2024-09-19T05:37:50.525795+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:37:50.525795+0000","last_undegraded":"2024-09-19T05:37:50.525795+0000","last_fullsized":"2024-09-19T05:37:50.525795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:49.836111+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:37:49.836111+0000","last_peered":"2024-09-19T05:37:49.836111+0000","last_clean":"2024-09-19T05:37:49.836111+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:37:49.836111+0000","last_undegraded":"2024-09-19T05:37:49.836111+0000","last_fullsized":"2024-09-19T05:37:49.836111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.525884+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:37:50.525884+0000","last_peered":"2024-09-19T05:37:50.525884+0000","last_clean":"2024-09-19T05:37:50.525884+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:37:50.525884+0000","last_undegraded":"2024-09-19T05:37:50.525884+0000","last_fullsized":"2024-09-19T05:37:50.525884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526777+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:37:50.526777+0000","last_peered":"2024-09-19T05:37:50.526777+0000","last_clean":"2024-09-19T05:37:50.526777+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:37:50.526777+0000","last_undegraded":"2024-09-19T05:37:50.526777+0000","last_fullsized":"2024-09-19T05:37:50.526777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T05:37:50.526294+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:37:50.526294+0000","last_peered":"2024-09-19T05:37:50.526294+0000","last_clean":"2024-09-19T05:37:50.526294+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:37:50.526294+0000","last_undegraded":"2024-09-19T05:37:50.526294+0000","last_fullsized":"2024-09-19T05:37:50.526294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5376,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":703220,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":115470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":112298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":111662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":111536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":702542,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:15.042 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:38:15.042 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T05:38:15.043 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T05:38:15.043 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T05:38:15.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.174+0000 7fd05828d640 1 Processor -- start 2024-09-19T05:38:15.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.174+0000 7fd05828d640 1 -- start start 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd05828d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0501550b0 0x7fd050073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd05828d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd05006d730 0x7fd0500ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd05828d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0500c9d00 con 0x7fd050155490 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd05828d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd05015edb0 con 0x7fd0501550b0 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd05828d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd05015e4a0 con 0x7fd05006d730 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd056029640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0501550b0 0x7fd050073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd056029640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0501550b0 0x7fd050073f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56444/0 (socket says 172.21.15.103:56444) 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.175+0000 7fd056029640 1 -- 172.21.15.103:0/4051470711 learned_addr learned my addr 172.21.15.103:0/4051470711 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:15.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd056029640 1 -- 172.21.15.103:0/4051470711 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd05006d730 msgr2=0x7fd0500ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:15.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd056029640 1 --2- 172.21.15.103:0/4051470711 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd05006d730 0x7fd0500ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd056029640 1 -- 172.21.15.103:0/4051470711 >> v1:172.21.15.174:6789/0 conn(0x7fd050155490 legacy=0x7fd0500ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:15.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd056029640 1 -- 172.21.15.103:0/4051470711 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0500c9fc0 con 0x7fd0501550b0 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd056029640 1 --2- 172.21.15.103:0/4051470711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd050073f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009870 tx=0x7fd04c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127e4e79faab71e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd055027640 1 -- 172.21.15.103:0/4051470711 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c037070 con 0x7fd0501550b0 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd055027640 1 -- 172.21.15.103:0/4051470711 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c032440 con 0x7fd0501550b0 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.176+0000 7fd055027640 1 -- 172.21.15.103:0/4051470711 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c032810 con 0x7fd0501550b0 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 -- 172.21.15.103:0/4051470711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 msgr2=0x7fd050073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 --2- 172.21.15.103:0/4051470711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd050073f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009870 tx=0x7fd04c02a2a0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 -- 172.21.15.103:0/4051470711 shutdown_connections 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 --2- 172.21.15.103:0/4051470711 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd05006d730 0x7fd0500ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 --2- 172.21.15.103:0/4051470711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd050073f60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 -- 172.21.15.103:0/4051470711 >> 172.21.15.103:0/4051470711 conn(0x7fd05006c240 msgr2=0x7fd050067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:15.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 -- 172.21.15.103:0/4051470711 shutdown_connections 2024-09-19T05:38:15.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.177+0000 7fd05828d640 1 -- 172.21.15.103:0/4051470711 wait complete. 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.178+0000 7fd05828d640 1 Processor -- start 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.178+0000 7fd05828d640 1 -- start start 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05828d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd0500c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05828d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050155490 0x7fd05015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05828d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0501496a0 0x7fd0501f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05828d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd05015f240 con 0x7fd0501550b0 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05828d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd05015ea40 con 0x7fd0501496a0 2024-09-19T05:38:15.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05828d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd050149150 con 0x7fd050155490 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd0500c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd0500c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56454/0 (socket says 172.21.15.103:56454) 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 -- 172.21.15.103:0/1989587906 learned_addr learned my addr 172.21.15.103:0/1989587906 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd055828640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050155490 0x7fd05015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05682a640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0501496a0 0x7fd0501f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 -- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050155490 msgr2=0x7fd05015d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050155490 0x7fd05015d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 -- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0501496a0 msgr2=0x7fd0501f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0501496a0 0x7fd0501f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd056029640 1 -- 172.21.15.103:0/1989587906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0500c6700 con 0x7fd0501550b0 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd05682a640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0501496a0 0x7fd0501f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.179+0000 7fd055828640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050155490 0x7fd05015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:15.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.180+0000 7fd056029640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd0500c7400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd04c000c00 tx=0x7fd04c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:15.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.180+0000 7fd046ffd640 1 -- 172.21.15.103:0/1989587906 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c041070 con 0x7fd0501550b0 2024-09-19T05:38:15.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.180+0000 7fd046ffd640 1 -- 172.21.15.103:0/1989587906 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c03c870 con 0x7fd0501550b0 2024-09-19T05:38:15.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.180+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0501f42a0 con 0x7fd0501550b0 2024-09-19T05:38:15.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.180+0000 7fd046ffd640 1 -- 172.21.15.103:0/1989587906 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c037040 con 0x7fd0501550b0 2024-09-19T05:38:15.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.180+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501f4860 con 0x7fd0501550b0 2024-09-19T05:38:15.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.181+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd050074520 con 0x7fd0501550b0 2024-09-19T05:38:15.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.181+0000 7fd046ffd640 1 -- 172.21.15.103:0/1989587906 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd04c044070 con 0x7fd0501550b0 2024-09-19T05:38:15.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.182+0000 7fd046ffd640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd03406c2e0 0x7fd03406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:15.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.182+0000 7fd046ffd640 1 -- 172.21.15.103:0/1989587906 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd04c0ac1a0 con 0x7fd0501550b0 2024-09-19T05:38:15.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.182+0000 7fd055828640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd03406c2e0 0x7fd03406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:15.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.182+0000 7fd055828640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd03406c2e0 0x7fd03406e7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd040006fd0 tx=0x7fd040008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:15.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.186+0000 7fd046ffd640 1 -- 172.21.15.103:0/1989587906 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd04c07a780 con 0x7fd0501550b0 2024-09-19T05:38:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.385+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd0500c9710 con 0x7fd0501550b0 2024-09-19T05:38:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.385+0000 7fd046ffd640 1 -- 172.21.15.103:0/1989587906 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fd04c07a080 con 0x7fd0501550b0 2024-09-19T05:38:15.387 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:15.387 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd03406c2e0 msgr2=0x7fd03406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd03406c2e0 0x7fd03406e7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd040006fd0 tx=0x7fd040008040 comp rx=0 tx=0).stop 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 msgr2=0x7fd0500c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd0500c7400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd04c000c00 tx=0x7fd04c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 shutdown_connections 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd03406c2e0 0x7fd03406e7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0501496a0 0x7fd0501f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050155490 0x7fd05015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 --2- 172.21.15.103:0/1989587906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0501550b0 0x7fd0500c7400 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:15.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 >> 172.21.15.103:0/1989587906 conn(0x7fd05006c240 msgr2=0x7fd050153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:15.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 shutdown_connections 2024-09-19T05:38:15.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:15.387+0000 7fd05828d640 1 -- 172.21.15.103:0/1989587906 wait complete. 2024-09-19T05:38:18.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T05:38:18.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.509+0000 7f41290dd640 1 Processor -- start 2024-09-19T05:38:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.509+0000 7f41290dd640 1 -- start start 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f41290dd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41240c46c0 0x7f41240c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f41290dd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f41240c3a50 0x7f412406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f41290dd640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412415bc80 con 0x7f4124151ea0 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f41290dd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f41241585a0 con 0x7f41240c3a50 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f41290dd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f4124157c70 con 0x7f41240c46c0 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f412359e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f41240c3a50 0x7f412406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f412359e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f41240c3a50 0x7f412406eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56458/0 (socket says 172.21.15.103:56458) 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f412359e640 1 -- 172.21.15.103:0/3264677122 learned_addr learned my addr 172.21.15.103:0/3264677122 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f411bfff640 1 --2- 172.21.15.103:0/3264677122 >> v2:172.21.15.174:3300/0 conn(0x7f41240c46c0 0x7f41240c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f412359e640 1 -- 172.21.15.103:0/3264677122 >> v2:172.21.15.174:3300/0 conn(0x7f41240c46c0 msgr2=0x7f41240c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f412359e640 1 --2- 172.21.15.103:0/3264677122 >> v2:172.21.15.174:3300/0 conn(0x7f41240c46c0 0x7f41240c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f412359e640 1 -- 172.21.15.103:0/3264677122 >> v1:172.21.15.174:6789/0 conn(0x7f4124151ea0 legacy=0x7f4124158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.510+0000 7f412359e640 1 -- 172.21.15.103:0/3264677122 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4124157f50 con 0x7f41240c3a50 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.511+0000 7f412359e640 1 --2- 172.21.15.103:0/3264677122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412406eed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f41240c3690 tx=0x7f411c02c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a37cc4221cad2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.511+0000 7f412259c640 1 -- 172.21.15.103:0/3264677122 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c035020 con 0x7f41240c3a50 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.511+0000 7f412259c640 1 -- 172.21.15.103:0/3264677122 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411c009600 con 0x7f41240c3a50 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.511+0000 7f412259c640 1 -- 172.21.15.103:0/3264677122 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c0099d0 con 0x7f41240c3a50 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 -- 172.21.15.103:0/3264677122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 msgr2=0x7f412406eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 --2- 172.21.15.103:0/3264677122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412406eed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f41240c3690 tx=0x7f411c02c9e0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 -- 172.21.15.103:0/3264677122 shutdown_connections 2024-09-19T05:38:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 --2- 172.21.15.103:0/3264677122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412406eed0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 --2- 172.21.15.103:0/3264677122 >> v2:172.21.15.174:3300/0 conn(0x7f41240c46c0 0x7f41240c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 -- 172.21.15.103:0/3264677122 >> 172.21.15.103:0/3264677122 conn(0x7f41240c9230 msgr2=0x7f41240c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 -- 172.21.15.103:0/3264677122 shutdown_connections 2024-09-19T05:38:18.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.512+0000 7f41290dd640 1 -- 172.21.15.103:0/3264677122 wait complete. 2024-09-19T05:38:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.513+0000 7f41290dd640 1 Processor -- start 2024-09-19T05:38:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.513+0000 7f41290dd640 1 -- start start 2024-09-19T05:38:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f41290dd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412413f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f41290dd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41240c46c0 0x7f41241efda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f41290dd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4124151ea0 0x7f412414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f41290dd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f41241596e0 con 0x7f41240c3a50 2024-09-19T05:38:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f41290dd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4124152280 con 0x7f41240c46c0 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f41290dd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4124158a30 con 0x7f4124151ea0 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412413f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412413f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56466/0 (socket says 172.21.15.103:56466) 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 -- 172.21.15.103:0/2930773663 learned_addr learned my addr 172.21.15.103:0/2930773663 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f411bfff640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41240c46c0 0x7f41241efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f412359e640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4124151ea0 0x7f412414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 -- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4124151ea0 msgr2=0x7f412414d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4124151ea0 0x7f412414d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 -- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41240c46c0 msgr2=0x7f41241efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41240c46c0 0x7f41241efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.514+0000 7f4122d9d640 1 -- 172.21.15.103:0/2930773663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4124072720 con 0x7f41240c3a50 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.515+0000 7f4122d9d640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412413f870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f411400c420 tx=0x7f411400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.515+0000 7f411b7fe640 1 -- 172.21.15.103:0/2930773663 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41140052d0 con 0x7f41240c3a50 2024-09-19T05:38:18.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.515+0000 7f411b7fe640 1 -- 172.21.15.103:0/2930773663 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4114005490 con 0x7f41240c3a50 2024-09-19T05:38:18.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.515+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41240729c0 con 0x7f41240c3a50 2024-09-19T05:38:18.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.515+0000 7f411b7fe640 1 -- 172.21.15.103:0/2930773663 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114007260 con 0x7f41240c3a50 2024-09-19T05:38:18.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.515+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4124072f80 con 0x7f41240c3a50 2024-09-19T05:38:18.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.516+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f412415bf20 con 0x7f41240c3a50 2024-09-19T05:38:18.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.516+0000 7f411b7fe640 1 -- 172.21.15.103:0/2930773663 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4114007400 con 0x7f41240c3a50 2024-09-19T05:38:18.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.517+0000 7f411b7fe640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f410406c2b0 0x7f410406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:18.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.517+0000 7f411bfff640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f410406c2b0 0x7f410406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:18.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.517+0000 7f411b7fe640 1 -- 172.21.15.103:0/2930773663 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f411408aa80 con 0x7f41240c3a50 2024-09-19T05:38:18.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.517+0000 7f411bfff640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f410406c2b0 0x7f410406e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f412414e1f0 tx=0x7f410c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:18.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.521+0000 7f411b7fe640 1 -- 172.21.15.103:0/2930773663 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f41140588f0 con 0x7f41240c3a50 2024-09-19T05:38:18.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.721+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f412414fd20 con 0x7f41240c3a50 2024-09-19T05:38:18.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.722+0000 7f411b7fe640 1 -- 172.21.15.103:0/2930773663 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f411405cbf0 con 0x7f41240c3a50 2024-09-19T05:38:18.725 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-09-19T05:38:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f410406c2b0 msgr2=0x7f410406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f410406c2b0 0x7f410406e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f412414e1f0 tx=0x7f410c009190 comp rx=0 tx=0).stop 2024-09-19T05:38:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 msgr2=0x7f412413f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412413f870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f411400c420 tx=0x7f411400c8e0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 shutdown_connections 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f410406c2b0 0x7f410406e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4124151ea0 0x7f412414d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41240c46c0 0x7f41241efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 --2- 172.21.15.103:0/2930773663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41240c3a50 0x7f412413f870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 >> 172.21.15.103:0/2930773663 conn(0x7f41240c9230 msgr2=0x7f4124150a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 shutdown_connections 2024-09-19T05:38:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:18.724+0000 7f41290dd640 1 -- 172.21.15.103:0/2930773663 wait complete. 2024-09-19T05:38:18.762 INFO:tasks.ceph.mds.e.smithi103.stderr:2024-09-19T05:38:18.760+0000 7f69a286b640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T05:38:21.737 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T05:38:21.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.846+0000 7f04bcfbd640 1 Processor -- start 2024-09-19T05:38:21.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.846+0000 7f04bcfbd640 1 -- start start 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04bcfbd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 0x7f04b80c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04bcfbd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b80b3350 con 0x7f04b80c7970 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04bcfbd640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b80b3070 con 0x7f04b80c8f60 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04bcfbd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f04b80b2e20 con 0x7f04b81552f0 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b5d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f04b80c7970 0x7f04b815b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51454/0 (socket says 172.21.15.103:51454) 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b5d9b640 1 -- 172.21.15.103:0/974141369 learned_addr learned my addr 172.21.15.103:0/974141369 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b659c640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 0x7f04b80c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617779289 0 0) 0x7f04b80b3350 con 0x7f04b80c7970 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04a0003520 con 0x7f04b80c7970 2024-09-19T05:38:21.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505677556 0 0) 0x7f04b80b3070 con 0x7f04b80c8f60 2024-09-19T05:38:21.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04b80b3350 con 0x7f04b80c8f60 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2526220340 0 0) 0x7f04a0003520 con 0x7f04b80c7970 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 msgr2=0x7f04b80c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 0x7f04b80c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 >> v1:172.21.15.174:6789/0 conn(0x7f04b80c8f60 legacy=0x7f04b8165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b80c8770 con 0x7f04b80c7970 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f04ac001670 con 0x7f04b80c7970 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b659c640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 0x7f04b80c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 >> v1:172.21.15.103:6789/0 conn(0x7f04b80c7970 legacy=0x7f04b815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 0x7f04a0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04a00040b0 0x7f04a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80b2e20 con 0x7f04a0004d40 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f04a000ba70 con 0x7f04a00040b0 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.847+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f04a000bc70 con 0x7f04b81552f0 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b6d9d640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b5d9b640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04a00040b0 0x7f04a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b659c640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 0x7f04a0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b6d9d640 1 -- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 msgr2=0x7f04a0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b6d9d640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b81552f0 0x7f04a0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b6d9d640 1 -- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04a00040b0 msgr2=0x7f04a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b6d9d640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04a00040b0 0x7f04a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.848+0000 7f04b6d9d640 1 -- 172.21.15.103:0/974141369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a0003520 con 0x7f04a0004d40 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04b6d9d640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04a00051c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f04a8001fd0 tx=0x7f04a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176c5445b47087ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8001bf0 con 0x7f04a0004d40 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a8003b70 con 0x7f04a0004d40 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04b559a640 1 -- 172.21.15.103:0/974141369 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a80050d0 con 0x7f04a0004d40 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04bcfbd640 1 -- 172.21.15.103:0/974141369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 msgr2=0x7f04a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04bcfbd640 1 --2- 172.21.15.103:0/974141369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04a00051c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f04a8001fd0 tx=0x7f04a0005830 comp rx=0 tx=0).stop 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04b6d9d640 1 -- 172.21.15.103:0/974141369 reap_dead start 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04bcfbd640 1 -- 172.21.15.103:0/974141369 shutdown_connections 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04bcfbd640 1 -- 172.21.15.103:0/974141369 >> 172.21.15.103:0/974141369 conn(0x7f04b80c9a70 msgr2=0x7f04b80c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04bcfbd640 1 -- 172.21.15.103:0/974141369 shutdown_connections 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.849+0000 7f04bcfbd640 1 -- 172.21.15.103:0/974141369 wait complete. 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 Processor -- start 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 -- start start 2024-09-19T05:38:21.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04b814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b8073030 0x7f04b814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8159a70 0x7f04b8159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f04b815af70 con 0x7f04a0004d40 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80c8d30 con 0x7f04b8159a70 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.851+0000 7f04bcfbd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f04b80c7e80 con 0x7f04b8073030 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04b814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04b814a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60148/0 (socket says 172.21.15.103:60148) 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 -- 172.21.15.103:0/1497909573 learned_addr learned my addr 172.21.15.103:0/1497909573 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b6d9d640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8159a70 0x7f04b8159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b5d9b640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b8073030 0x7f04b814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 -- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b8073030 msgr2=0x7f04b814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b8073030 0x7f04b814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 -- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8159a70 msgr2=0x7f04b8159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8159a70 0x7f04b8159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 -- 172.21.15.103:0/1497909573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b815a430 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04b659c640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04b814a920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04b00119d0 tx=0x7f04b0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04a6ffd640 1 -- 172.21.15.103:0/1497909573 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b000faf0 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04a6ffd640 1 -- 172.21.15.103:0/1497909573 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b000fc90 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b8073500 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04a6ffd640 1 -- 172.21.15.103:0/1497909573 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0014440 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.852+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b8158f90 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.853+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b80693d0 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.854+0000 7f04a6ffd640 1 -- 172.21.15.103:0/1497909573 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f04b0012040 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.854+0000 7f04a6ffd640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f049806c2b0 0x7f049806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.854+0000 7f04a6ffd640 1 -- 172.21.15.103:0/1497909573 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f04b008bcb0 con 0x7f04a0004d40 2024-09-19T05:38:21.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.854+0000 7f04b5d9b640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f049806c2b0 0x7f049806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:21.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.855+0000 7f04b5d9b640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f049806c2b0 0x7f049806e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04b8073430 tx=0x7f04ac001e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:21.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:21.859+0000 7f04a6ffd640 1 -- 172.21.15.103:0/1497909573 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f04b815a430 con 0x7f04a0004d40 2024-09-19T05:38:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.059+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f04b80c8200 con 0x7f04a0004d40 2024-09-19T05:38:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.059+0000 7f04a6ffd640 1 -- 172.21.15.103:0/1497909573 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f04b0019030 con 0x7f04a0004d40 2024-09-19T05:38:22.061 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:22.061 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-09-19T05:38:22.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.061+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f049806c2b0 msgr2=0x7f049806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.061+0000 7f04bcfbd640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f049806c2b0 0x7f049806e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04b8073430 tx=0x7f04ac001e40 comp rx=0 tx=0).stop 2024-09-19T05:38:22.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.061+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 msgr2=0x7f04b814a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:22.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.061+0000 7f04bcfbd640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04b814a920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04b00119d0 tx=0x7f04b0011e90 comp rx=0 tx=0).stop 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 shutdown_connections 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f049806c2b0 0x7f049806e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8159a70 0x7f04b8159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b8073030 0x7f04b814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 --2- 172.21.15.103:0/1497909573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04a0004d40 0x7f04b814a920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 >> 172.21.15.103:0/1497909573 conn(0x7f04b80c9a70 msgr2=0x7f04b8150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 shutdown_connections 2024-09-19T05:38:22.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:22.062+0000 7f04bcfbd640 1 -- 172.21.15.103:0/1497909573 wait complete. 2024-09-19T05:38:25.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T05:38:25.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.182+0000 7f9391065640 1 Processor -- start 2024-09-19T05:38:25.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.182+0000 7f9391065640 1 -- start start 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f9391065640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f938c0c46c0 0x7f938c0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f9391065640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f938c0c3a50 0x7f938c06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f9391065640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938c15bc80 con 0x7f938c151ea0 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f9391065640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f938c1585a0 con 0x7f938c0c3a50 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f9391065640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f938c157c70 con 0x7f938c0c46c0 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938b59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f938c0c3a50 0x7f938c06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938b59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f938c0c3a50 0x7f938c06eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60164/0 (socket says 172.21.15.103:60164) 2024-09-19T05:38:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938b59e640 1 -- 172.21.15.103:0/392525522 learned_addr learned my addr 172.21.15.103:0/392525522 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938a59c640 1 --2- 172.21.15.103:0/392525522 >> v2:172.21.15.174:3300/0 conn(0x7f938c0c46c0 0x7f938c0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938b59e640 1 -- 172.21.15.103:0/392525522 >> v2:172.21.15.174:3300/0 conn(0x7f938c0c46c0 msgr2=0x7f938c0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938b59e640 1 --2- 172.21.15.103:0/392525522 >> v2:172.21.15.174:3300/0 conn(0x7f938c0c46c0 0x7f938c0c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938b59e640 1 -- 172.21.15.103:0/392525522 >> v1:172.21.15.174:6789/0 conn(0x7f938c151ea0 legacy=0x7f938c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938b59e640 1 -- 172.21.15.103:0/392525522 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c157f50 con 0x7f938c0c3a50 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.183+0000 7f938a59c640 1 --2- 172.21.15.103:0/392525522 >> v2:172.21.15.174:3300/0 conn(0x7f938c0c46c0 0x7f938c0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.184+0000 7f938b59e640 1 --2- 172.21.15.103:0/392525522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c3a50 0x7f938c06eed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f938c0c3690 tx=0x7f938402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918e668cf1a62c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.184+0000 7f9389d9b640 1 -- 172.21.15.103:0/392525522 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384036070 con 0x7f938c0c3a50 2024-09-19T05:38:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.184+0000 7f9389d9b640 1 -- 172.21.15.103:0/392525522 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9384031600 con 0x7f938c0c3a50 2024-09-19T05:38:25.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.184+0000 7f9389d9b640 1 -- 172.21.15.103:0/392525522 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93840319d0 con 0x7f938c0c3a50 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 -- 172.21.15.103:0/392525522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c3a50 msgr2=0x7f938c06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 --2- 172.21.15.103:0/392525522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c3a50 0x7f938c06eed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f938c0c3690 tx=0x7f938402a780 comp rx=0 tx=0).stop 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 -- 172.21.15.103:0/392525522 shutdown_connections 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 --2- 172.21.15.103:0/392525522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c3a50 0x7f938c06eed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 --2- 172.21.15.103:0/392525522 >> v2:172.21.15.174:3300/0 conn(0x7f938c0c46c0 0x7f938c0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 -- 172.21.15.103:0/392525522 >> 172.21.15.103:0/392525522 conn(0x7f938c0c9230 msgr2=0x7f938c0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 -- 172.21.15.103:0/392525522 shutdown_connections 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.185+0000 7f9391065640 1 -- 172.21.15.103:0/392525522 wait complete. 2024-09-19T05:38:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.186+0000 7f9391065640 1 Processor -- start 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f9391065640 1 -- start start 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f9391065640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c0c3a50 0x7f938c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f9391065640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c46c0 0x7f938c155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f9391065640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c151ea0 0x7f938c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f9391065640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f938c1596e0 con 0x7f938c0c46c0 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f9391065640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f938c152280 con 0x7f938c151ea0 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f9391065640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f938c158a30 con 0x7f938c0c3a50 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f938a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c46c0 0x7f938c155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f938a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c46c0 0x7f938c155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60172/0 (socket says 172.21.15.103:60172) 2024-09-19T05:38:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.187+0000 7f938a59c640 1 -- 172.21.15.103:0/3526248215 learned_addr learned my addr 172.21.15.103:0/3526248215 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938ad9d640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c0c3a50 0x7f938c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938b59e640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c151ea0 0x7f938c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938a59c640 1 -- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c0c3a50 msgr2=0x7f938c156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938a59c640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c0c3a50 0x7f938c156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938a59c640 1 -- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c151ea0 msgr2=0x7f938c15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938a59c640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c151ea0 0x7f938c15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938a59c640 1 -- 172.21.15.103:0/3526248215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c1572e0 con 0x7f938c0c46c0 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938b59e640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c151ea0 0x7f938c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f938a59c640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c46c0 0x7f938c155a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f937400c7f0 tx=0x7f937400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f93837fe640 1 -- 172.21.15.103:0/3526248215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374015070 con 0x7f938c0c46c0 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f93837fe640 1 -- 172.21.15.103:0/3526248215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9374007a30 con 0x7f938c0c46c0 2024-09-19T05:38:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938c0738c0 con 0x7f938c0c46c0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f93837fe640 1 -- 172.21.15.103:0/3526248215 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374007e00 con 0x7f938c0c46c0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.188+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938c159d50 con 0x7f938c0c46c0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.189+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938c159860 con 0x7f938c0c46c0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.190+0000 7f93837fe640 1 -- 172.21.15.103:0/3526248215 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9374018070 con 0x7f938c0c46c0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.190+0000 7f93837fe640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f936c06c2b0 0x7f936c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.190+0000 7f93837fe640 1 -- 172.21.15.103:0/3526248215 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f937408b790 con 0x7f938c0c46c0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.190+0000 7f938ad9d640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f936c06c2b0 0x7f936c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.190+0000 7f938ad9d640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f936c06c2b0 0x7f936c06e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f937c006fd0 tx=0x7f937c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.194+0000 7f93837fe640 1 -- 172.21.15.103:0/3526248215 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9374059b90 con 0x7f938c0c46c0 2024-09-19T05:38:25.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.394+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f938c15bf20 con 0x7f938c0c46c0 2024-09-19T05:38:25.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.394+0000 7f93837fe640 1 -- 172.21.15.103:0/3526248215 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9374059490 con 0x7f938c0c46c0 2024-09-19T05:38:25.397 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:25.397 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f936c06c2b0 msgr2=0x7f936c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f936c06c2b0 0x7f936c06e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f937c006fd0 tx=0x7f937c008040 comp rx=0 tx=0).stop 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c46c0 msgr2=0x7f938c155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c46c0 0x7f938c155a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f937400c7f0 tx=0x7f937400cbf0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 shutdown_connections 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f936c06c2b0 0x7f936c06e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f938c151ea0 0x7f938c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f938c0c46c0 0x7f938c155a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 --2- 172.21.15.103:0/3526248215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938c0c3a50 0x7f938c156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 >> 172.21.15.103:0/3526248215 conn(0x7f938c0c9230 msgr2=0x7f938c1506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:25.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 shutdown_connections 2024-09-19T05:38:25.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.396+0000 7f9391065640 1 -- 172.21.15.103:0/3526248215 wait complete. 2024-09-19T05:38:25.409 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T05:38:25.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:25.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.505+0000 7f0323733640 1 Processor -- start 2024-09-19T05:38:25.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.505+0000 7f0323733640 1 -- start start 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0323733640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f031c155040 0x7f031c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0323733640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0c5950 0x7f031c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0323733640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f031c0cbed0 con 0x7f031c0b3540 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0323733640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f031c15bd70 con 0x7f031c155040 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0323733640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f031c0cbbf0 con 0x7f031c0c5950 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0320cce640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f031c0b3540 0x7f031c15e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51464/0 (socket says 172.21.15.103:51464) 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0320cce640 1 -- 172.21.15.103:0/1620274916 learned_addr learned my addr 172.21.15.103:0/1620274916 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0321cd0640 1 --2- 172.21.15.103:0/1620274916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0c5950 0x7f031c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f03214cf640 1 --2- 172.21.15.103:0/1620274916 >> v2:172.21.15.174:3300/0 conn(0x7f031c155040 0x7f031c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0313fff640 1 -- 172.21.15.103:0/1620274916 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219112287 0 0) 0x7f031c0cbed0 con 0x7f031c0b3540 2024-09-19T05:38:25.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.506+0000 7f0313fff640 1 -- 172.21.15.103:0/1620274916 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0308003520 con 0x7f031c0b3540 2024-09-19T05:38:25.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.507+0000 7f0321cd0640 1 -- 172.21.15.103:0/1620274916 >> v2:172.21.15.174:3300/0 conn(0x7f031c155040 msgr2=0x7f031c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:25.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.507+0000 7f0321cd0640 1 --2- 172.21.15.103:0/1620274916 >> v2:172.21.15.174:3300/0 conn(0x7f031c155040 0x7f031c0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.507+0000 7f0321cd0640 1 -- 172.21.15.103:0/1620274916 >> v1:172.21.15.103:6789/0 conn(0x7f031c0b3540 legacy=0x7f031c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.507+0000 7f0321cd0640 1 -- 172.21.15.103:0/1620274916 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c15afb0 con 0x7f031c0c5950 2024-09-19T05:38:25.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.507+0000 7f03214cf640 1 --2- 172.21.15.103:0/1620274916 >> v2:172.21.15.174:3300/0 conn(0x7f031c155040 0x7f031c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:25.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.507+0000 7f0321cd0640 1 --2- 172.21.15.103:0/1620274916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0c5950 0x7f031c0cc2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0314009d90 tx=0x7f031402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f7916574f700033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.507+0000 7f0313fff640 1 -- 172.21.15.103:0/1620274916 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314007740 con 0x7f031c0c5950 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0313fff640 1 -- 172.21.15.103:0/1620274916 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03140078e0 con 0x7f031c0c5950 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0313fff640 1 -- 172.21.15.103:0/1620274916 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314007c90 con 0x7f031c0c5950 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 -- 172.21.15.103:0/1620274916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0c5950 msgr2=0x7f031c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 --2- 172.21.15.103:0/1620274916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0c5950 0x7f031c0cc2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0314009d90 tx=0x7f031402a660 comp rx=0 tx=0).stop 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 -- 172.21.15.103:0/1620274916 shutdown_connections 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 --2- 172.21.15.103:0/1620274916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0c5950 0x7f031c0cc2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 --2- 172.21.15.103:0/1620274916 >> v2:172.21.15.174:3300/0 conn(0x7f031c155040 0x7f031c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 -- 172.21.15.103:0/1620274916 >> 172.21.15.103:0/1620274916 conn(0x7f031c073340 msgr2=0x7f031c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 -- 172.21.15.103:0/1620274916 shutdown_connections 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.508+0000 7f0323733640 1 -- 172.21.15.103:0/1620274916 wait complete. 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.509+0000 7f0323733640 1 Processor -- start 2024-09-19T05:38:25.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.509+0000 7f0323733640 1 -- start start 2024-09-19T05:38:25.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0323733640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0b3540 0x7f031c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0323733640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f031c0c5950 0x7f031c150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0323733640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f031c155040 0x7f031c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0323733640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f031c15b850 con 0x7f031c155040 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0323733640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f031c15b570 con 0x7f031c0c5950 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0323733640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f031c15eb30 con 0x7f031c0b3540 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f031c155040 0x7f031c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f031c155040 0x7f031c158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60190/0 (socket says 172.21.15.103:60190) 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 -- 172.21.15.103:0/318391295 learned_addr learned my addr 172.21.15.103:0/318391295 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0320cce640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f031c0c5950 0x7f031c150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f03214cf640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0b3540 0x7f031c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 -- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0b3540 msgr2=0x7f031c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0b3540 0x7f031c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 -- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f031c0c5950 msgr2=0x7f031c150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f031c0c5950 0x7f031c150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.510+0000 7f0321cd0640 1 -- 172.21.15.103:0/318391295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c15abf0 con 0x7f031c155040 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.511+0000 7f0321cd0640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f031c155040 0x7f031c158a70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0314009eb0 tx=0x7f0314004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.511+0000 7f0311ffb640 1 -- 172.21.15.103:0/318391295 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314040070 con 0x7f031c155040 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.511+0000 7f0311ffb640 1 -- 172.21.15.103:0/318391295 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0314031c60 con 0x7f031c155040 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.511+0000 7f0311ffb640 1 -- 172.21.15.103:0/318391295 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314009450 con 0x7f031c155040 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.511+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c1f4270 con 0x7f031c155040 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.511+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c1f4830 con 0x7f031c155040 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.512+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031c0cb540 con 0x7f031c155040 2024-09-19T05:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.512+0000 7f0311ffb640 1 -- 172.21.15.103:0/318391295 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0314039040 con 0x7f031c155040 2024-09-19T05:38:25.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.513+0000 7f0311ffb640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f030006c2b0 0x7f030006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.513+0000 7f0311ffb640 1 -- 172.21.15.103:0/318391295 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f03140ac7e0 con 0x7f031c155040 2024-09-19T05:38:25.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.513+0000 7f03214cf640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f030006c2b0 0x7f030006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.513+0000 7f03214cf640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f030006c2b0 0x7f030006e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0318009560 tx=0x7f0318009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.517+0000 7f0311ffb640 1 -- 172.21.15.103:0/318391295 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f031407a500 con 0x7f031c155040 2024-09-19T05:38:25.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.714+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f031c069380 con 0x7f031c155040 2024-09-19T05:38:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.714+0000 7f0311ffb640 1 -- 172.21.15.103:0/318391295 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6961 (secure 0 0 0) 0x7f031407e800 con 0x7f031c155040 2024-09-19T05:38:25.717 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:25.717 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-09-19T05:38:23:941117+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:23.941098+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4299,4296,4302,4276]},"id":1}]} 2024-09-19T05:38:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f030006c2b0 msgr2=0x7f030006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f030006c2b0 0x7f030006e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0318009560 tx=0x7f0318009190 comp rx=0 tx=0).stop 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f031c155040 msgr2=0x7f031c158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f031c155040 0x7f031c158a70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0314009eb0 tx=0x7f0314004a40 comp rx=0 tx=0).stop 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 shutdown_connections 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f030006c2b0 0x7f030006e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f031c155040 0x7f031c158a70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f031c0c5950 0x7f031c150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 --2- 172.21.15.103:0/318391295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031c0b3540 0x7f031c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 >> 172.21.15.103:0/318391295 conn(0x7f031c073340 msgr2=0x7f031c073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 shutdown_connections 2024-09-19T05:38:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.716+0000 7f0323733640 1 -- 172.21.15.103:0/318391295 wait complete. 2024-09-19T05:38:25.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:25.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.827+0000 7f9cb920e640 1 Processor -- start 2024-09-19T05:38:25.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.827+0000 7f9cb920e640 1 -- start start 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9cb920e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cb406d730 0x7f9cb4073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9cb920e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cb4155490 0x7f9cb40ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9cb920e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb40c9d00 con 0x7f9cb41550b0 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9cb920e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb415edb0 con 0x7f9cb406d730 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9cb920e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb40ca9b0 con 0x7f9cb4155490 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9caa59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cb406d730 0x7f9cb4073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9caa59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cb406d730 0x7f9cb4073f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60196/0 (socket says 172.21.15.103:60196) 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9caa59c640 1 -- 172.21.15.103:0/1390623665 learned_addr learned my addr 172.21.15.103:0/1390623665 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9cb359e640 1 --2- 172.21.15.103:0/1390623665 >> v2:172.21.15.174:3300/0 conn(0x7f9cb4155490 0x7f9cb40ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9caa59c640 1 -- 172.21.15.103:0/1390623665 >> v2:172.21.15.174:3300/0 conn(0x7f9cb4155490 msgr2=0x7f9cb40ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:25.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9caa59c640 1 --2- 172.21.15.103:0/1390623665 >> v2:172.21.15.174:3300/0 conn(0x7f9cb4155490 0x7f9cb40ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9caa59c640 1 -- 172.21.15.103:0/1390623665 >> v1:172.21.15.174:6789/0 conn(0x7f9cb41550b0 legacy=0x7f9cb40ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:25.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.828+0000 7f9caa59c640 1 -- 172.21.15.103:0/1390623665 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb415e4a0 con 0x7f9cb406d730 2024-09-19T05:38:25.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9caa59c640 1 --2- 172.21.15.103:0/1390623665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb406d730 0x7f9cb4073f60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4073a10 tx=0x7f9c9c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b181c250b606552 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb259c640 1 -- 172.21.15.103:0/1390623665 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c037070 con 0x7f9cb406d730 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb259c640 1 -- 172.21.15.103:0/1390623665 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9c032440 con 0x7f9cb406d730 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb259c640 1 -- 172.21.15.103:0/1390623665 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c032810 con 0x7f9cb406d730 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 -- 172.21.15.103:0/1390623665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb406d730 msgr2=0x7f9cb4073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 --2- 172.21.15.103:0/1390623665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb406d730 0x7f9cb4073f60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4073a10 tx=0x7f9c9c02a2c0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 -- 172.21.15.103:0/1390623665 shutdown_connections 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 --2- 172.21.15.103:0/1390623665 >> v2:172.21.15.174:3300/0 conn(0x7f9cb4155490 0x7f9cb40ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 --2- 172.21.15.103:0/1390623665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb406d730 0x7f9cb4073f60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 -- 172.21.15.103:0/1390623665 >> 172.21.15.103:0/1390623665 conn(0x7f9cb406c240 msgr2=0x7f9cb4067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:25.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 -- 172.21.15.103:0/1390623665 shutdown_connections 2024-09-19T05:38:25.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.829+0000 7f9cb920e640 1 -- 172.21.15.103:0/1390623665 wait complete. 2024-09-19T05:38:25.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.831+0000 7f9cb920e640 1 Processor -- start 2024-09-19T05:38:25.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.831+0000 7f9cb920e640 1 -- start start 2024-09-19T05:38:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb41550b0 0x7f9cb40c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cb4155490 0x7f9cb40c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cb41536f0 0x7f9cb414c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb415ea40 con 0x7f9cb41550b0 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb415e760 con 0x7f9cb41536f0 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb415f240 con 0x7f9cb4155490 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb41550b0 0x7f9cb40c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb41550b0 0x7f9cb40c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60202/0 (socket says 172.21.15.103:60202) 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 -- 172.21.15.103:0/3578430052 learned_addr learned my addr 172.21.15.103:0/3578430052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb359e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cb41536f0 0x7f9cb414c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9caa59c640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cb4155490 0x7f9cb40c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 -- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cb4155490 msgr2=0x7f9cb40c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cb4155490 0x7f9cb40c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 -- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cb41536f0 msgr2=0x7f9cb414c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cb41536f0 0x7f9cb414c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 -- 172.21.15.103:0/3578430052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb414dc60 con 0x7f9cb41550b0 2024-09-19T05:38:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb359e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cb41536f0 0x7f9cb414c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb2d9d640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb41550b0 0x7f9cb40c6b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c460 tx=0x7f9ca400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cabfff640 1 -- 172.21.15.103:0/3578430052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4016020 con 0x7f9cb41550b0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cabfff640 1 -- 172.21.15.103:0/3578430052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca4012870 con 0x7f9cb41550b0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cabfff640 1 -- 172.21.15.103:0/3578430052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4012c60 con 0x7f9cb41550b0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb414d120 con 0x7f9cb41550b0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.832+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb414d6a0 con 0x7f9cb41550b0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.833+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb4074520 con 0x7f9cb41550b0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.834+0000 7f9cabfff640 1 -- 172.21.15.103:0/3578430052 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ca4019020 con 0x7f9cb41550b0 2024-09-19T05:38:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.834+0000 7f9cabfff640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.834+0000 7f9cabfff640 1 -- 172.21.15.103:0/3578430052 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9ca408b3c0 con 0x7f9cb41550b0 2024-09-19T05:38:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.834+0000 7f9caa59c640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.835+0000 7f9caa59c640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c034000 tx=0x7f9c9c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:25.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:25.839+0000 7f9cabfff640 1 -- 172.21.15.103:0/3578430052 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9ca4020070 con 0x7f9cb41550b0 2024-09-19T05:38:26.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.045+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cb4152170 con 0x7f9cb41550b0 2024-09-19T05:38:26.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.046+0000 7f9cabfff640 1 -- 172.21.15.103:0/3578430052 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6961 (secure 0 0 0) 0x7f9ca4059620 con 0x7f9cb41550b0 2024-09-19T05:38:26.048 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:26.049 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-09-19T05:38:23:941117+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:23.941098+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4299,4296,4302,4276]},"id":1}]} 2024-09-19T05:38:26.049 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-09-19T05:38:26.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9c9406c2e0 msgr2=0x7f9c9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c034000 tx=0x7f9c9c02e000 comp rx=0 tx=0).stop 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb41550b0 msgr2=0x7f9cb40c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb41550b0 0x7f9cb40c6b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c460 tx=0x7f9ca400c920 comp rx=0 tx=0).stop 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 shutdown_connections 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9c9406c2e0 0x7f9c9406e7a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cb41536f0 0x7f9cb414c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cb4155490 0x7f9cb40c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 --2- 172.21.15.103:0/3578430052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb41550b0 0x7f9cb40c6b40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 >> 172.21.15.103:0/3578430052 conn(0x7f9cb406c240 msgr2=0x7f9cb4067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 shutdown_connections 2024-09-19T05:38:26.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.048+0000 7f9cb920e640 1 -- 172.21.15.103:0/3578430052 wait complete. 2024-09-19T05:38:26.062 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:26.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.157+0000 7f004ece4640 1 Processor -- start 2024-09-19T05:38:26.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.157+0000 7f004ece4640 1 -- start start 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f004ece4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0048074480 0x7f0048158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f004ece4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f004815c330 con 0x7f0048153100 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f004ece4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f004815c610 con 0x7f0048152d20 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f004ece4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f004815d190 con 0x7f0048074480 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f0047fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0048153100 0x7f00480c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51474/0 (socket says 172.21.15.103:51474) 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f0047fff640 1 -- 172.21.15.103:0/3105957469 learned_addr learned my addr 172.21.15.103:0/3105957469 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f004d281640 1 --2- 172.21.15.103:0/3105957469 >> v2:172.21.15.103:3300/0 conn(0x7f0048074480 0x7f0048158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f00477fe640 1 -- 172.21.15.103:0/3105957469 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874833266 0 0) 0x7f004815c330 con 0x7f0048153100 2024-09-19T05:38:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.158+0000 7f00477fe640 1 -- 172.21.15.103:0/3105957469 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0030003520 con 0x7f0048153100 2024-09-19T05:38:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.159+0000 7f004d281640 1 -- 172.21.15.103:0/3105957469 >> v1:172.21.15.174:6789/0 conn(0x7f0048152d20 legacy=0x7f004806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.159+0000 7f004d281640 1 -- 172.21.15.103:0/3105957469 >> v1:172.21.15.103:6789/0 conn(0x7f0048153100 legacy=0x7f00480c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.159+0000 7f004d281640 1 -- 172.21.15.103:0/3105957469 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004815c8f0 con 0x7f0048074480 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.159+0000 7f004d281640 1 --2- 172.21.15.103:0/3105957469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f0048158ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0040009d90 tx=0x7f004002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c3075e1f268d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.159+0000 7f00477fe640 1 -- 172.21.15.103:0/3105957469 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040031600 con 0x7f0048074480 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.159+0000 7f00477fe640 1 -- 172.21.15.103:0/3105957469 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00400317a0 con 0x7f0048074480 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.159+0000 7f00477fe640 1 -- 172.21.15.103:0/3105957469 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040031b70 con 0x7f0048074480 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.160+0000 7f004ece4640 1 -- 172.21.15.103:0/3105957469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 msgr2=0x7f0048158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.160+0000 7f004ece4640 1 --2- 172.21.15.103:0/3105957469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f0048158ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0040009d90 tx=0x7f004002a5d0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.160+0000 7f004ece4640 1 -- 172.21.15.103:0/3105957469 shutdown_connections 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.160+0000 7f004ece4640 1 --2- 172.21.15.103:0/3105957469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f0048158ff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.160+0000 7f004ece4640 1 -- 172.21.15.103:0/3105957469 >> 172.21.15.103:0/3105957469 conn(0x7f00480c9230 msgr2=0x7f00480c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.160+0000 7f004ece4640 1 -- 172.21.15.103:0/3105957469 shutdown_connections 2024-09-19T05:38:26.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.160+0000 7f004ece4640 1 -- 172.21.15.103:0/3105957469 wait complete. 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.161+0000 7f004ece4640 1 Processor -- start 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.161+0000 7f004ece4640 1 -- start start 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ece4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f00481f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ece4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0048152d20 0x7f004815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ece4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0048153100 0x7f00481f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ece4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f004806cfe0 con 0x7f0048074480 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ece4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f004815ceb0 con 0x7f0048152d20 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ece4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f004806d160 con 0x7f0048153100 2024-09-19T05:38:26.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f00481f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f00481f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60216/0 (socket says 172.21.15.103:60216) 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 -- 172.21.15.103:0/3814266794 learned_addr learned my addr 172.21.15.103:0/3814266794 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f0047fff640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0048152d20 0x7f004815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004d281640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0048153100 0x7f00481f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 -- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0048153100 msgr2=0x7f00481f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0048153100 0x7f00481f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 -- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0048152d20 msgr2=0x7f004815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0048152d20 0x7f004815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.162+0000 7f004ca80640 1 -- 172.21.15.103:0/3814266794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004815ba00 con 0x7f0048074480 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.163+0000 7f004ca80640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f00481f4a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f003800c3f0 tx=0x7f003800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.163+0000 7f00457fa640 1 -- 172.21.15.103:0/3814266794 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00380052d0 con 0x7f0048074480 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.163+0000 7f00457fa640 1 -- 172.21.15.103:0/3814266794 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0038005490 con 0x7f0048074480 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.163+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004815bce0 con 0x7f0048074480 2024-09-19T05:38:26.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.163+0000 7f00457fa640 1 -- 172.21.15.103:0/3814266794 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038007260 con 0x7f0048074480 2024-09-19T05:38:26.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.163+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00481f4210 con 0x7f0048074480 2024-09-19T05:38:26.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.164+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004806c8d0 con 0x7f0048074480 2024-09-19T05:38:26.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.164+0000 7f00457fa640 1 -- 172.21.15.103:0/3814266794 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0038007400 con 0x7f0048074480 2024-09-19T05:38:26.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.165+0000 7f00457fa640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f003406c2b0 0x7f003406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.165+0000 7f0047fff640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f003406c2b0 0x7f003406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.165+0000 7f00457fa640 1 -- 172.21.15.103:0/3814266794 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f003808abe0 con 0x7f0048074480 2024-09-19T05:38:26.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.165+0000 7f0047fff640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f003406c2b0 0x7f003406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00480caf20 tx=0x7f003c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.169+0000 7f00457fa640 1 -- 172.21.15.103:0/3814266794 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0038058990 con 0x7f0048074480 2024-09-19T05:38:26.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.335+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00480ca8b0 con 0x7f0048074480 2024-09-19T05:38:26.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.337+0000 7f00457fa640 1 -- 172.21.15.103:0/3814266794 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+19059 (secure 0 0 0) 0x7f003805de20 con 0x7f0048074480 2024-09-19T05:38:26.339 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:26.340 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:38:25.956806+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f003406c2b0 msgr2=0x7f003406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f003406c2b0 0x7f003406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00480caf20 tx=0x7f003c007d30 comp rx=0 tx=0).stop 2024-09-19T05:38:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 msgr2=0x7f00481f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f00481f4a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f003800c3f0 tx=0x7f003800c8b0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 shutdown_connections 2024-09-19T05:38:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f003406c2b0 0x7f003406e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0048153100 0x7f00481f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0048152d20 0x7f004815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 --2- 172.21.15.103:0/3814266794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0048074480 0x7f00481f4a10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 >> 172.21.15.103:0/3814266794 conn(0x7f00480c9230 msgr2=0x7f0048071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 shutdown_connections 2024-09-19T05:38:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.339+0000 7f004ece4640 1 -- 172.21.15.103:0/3814266794 wait complete. 2024-09-19T05:38:26.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:26.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.449+0000 7f3183fd6640 1 Processor -- start 2024-09-19T05:38:26.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.449+0000 7f3183fd6640 1 -- start start 2024-09-19T05:38:26.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3183fd6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f317c0c7310 0x7f317c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3183fd6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c070bc0 0x7f317c153140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3183fd6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f317c15c9d0 con 0x7f317c0c6f30 2024-09-19T05:38:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3183fd6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f317c0c4b40 con 0x7f317c0c7310 2024-09-19T05:38:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3183fd6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f317c0c5100 con 0x7f317c070bc0 2024-09-19T05:38:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3182573640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c070bc0 0x7f317c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3181571640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f317c0c7310 0x7f317c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3181d72640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f317c0c6f30 0x7f317c15c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:35798/0 (socket says 172.21.15.103:35798) 2024-09-19T05:38:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3181d72640 1 -- 172.21.15.103:0/3171986607 learned_addr learned my addr 172.21.15.103:0/3171986607 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3182573640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c070bc0 0x7f317c153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:47604/0 (socket says 172.21.15.103:47604) 2024-09-19T05:38:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3182573640 1 -- 172.21.15.103:0/3171986607 >> v2:172.21.15.174:3300/0 conn(0x7f317c0c7310 msgr2=0x7f317c152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3182573640 1 --2- 172.21.15.103:0/3171986607 >> v2:172.21.15.174:3300/0 conn(0x7f317c0c7310 0x7f317c152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3182573640 1 -- 172.21.15.103:0/3171986607 >> v1:172.21.15.174:6789/0 conn(0x7f317c0c6f30 legacy=0x7f317c15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.450+0000 7f3182573640 1 -- 172.21.15.103:0/3171986607 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c06d9e0 con 0x7f317c070bc0 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.451+0000 7f3181571640 1 --2- 172.21.15.103:0/3171986607 >> v2:172.21.15.174:3300/0 conn(0x7f317c0c7310 0x7f317c152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.451+0000 7f3182573640 1 --2- 172.21.15.103:0/3171986607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c070bc0 0x7f317c153140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3174009d90 tx=0x7f317402a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab430a0ecfadbc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.451+0000 7f3180d70640 1 -- 172.21.15.103:0/3171986607 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174007740 con 0x7f317c070bc0 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.451+0000 7f3180d70640 1 -- 172.21.15.103:0/3171986607 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31740078e0 con 0x7f317c070bc0 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.451+0000 7f3180d70640 1 -- 172.21.15.103:0/3171986607 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174007cb0 con 0x7f317c070bc0 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 -- 172.21.15.103:0/3171986607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c070bc0 msgr2=0x7f317c153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 --2- 172.21.15.103:0/3171986607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c070bc0 0x7f317c153140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3174009d90 tx=0x7f317402a530 comp rx=0 tx=0).stop 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 -- 172.21.15.103:0/3171986607 shutdown_connections 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 --2- 172.21.15.103:0/3171986607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c070bc0 0x7f317c153140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 --2- 172.21.15.103:0/3171986607 >> v2:172.21.15.174:3300/0 conn(0x7f317c0c7310 0x7f317c152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 -- 172.21.15.103:0/3171986607 >> 172.21.15.103:0/3171986607 conn(0x7f317c06cd20 msgr2=0x7f317c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:26.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 -- 172.21.15.103:0/3171986607 shutdown_connections 2024-09-19T05:38:26.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.452+0000 7f3183fd6640 1 -- 172.21.15.103:0/3171986607 wait complete. 2024-09-19T05:38:26.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.453+0000 7f3183fd6640 1 Processor -- start 2024-09-19T05:38:26.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.453+0000 7f3183fd6640 1 -- start start 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3183fd6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f317c070bc0 0x7f317c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3183fd6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f317c0c6f30 0x7f317c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3183fd6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c0c7310 0x7f317c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3183fd6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f317c06ee90 con 0x7f317c070bc0 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3183fd6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f317c0c4d90 con 0x7f317c0c6f30 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3183fd6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f317c0c5590 con 0x7f317c0c7310 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f317c070bc0 0x7f317c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f317c070bc0 0x7f317c073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60220/0 (socket says 172.21.15.103:60220) 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 -- 172.21.15.103:0/339611548 learned_addr learned my addr 172.21.15.103:0/339611548 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181571640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f317c0c6f30 0x7f317c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3182573640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c0c7310 0x7f317c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 -- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c0c7310 msgr2=0x7f317c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c0c7310 0x7f317c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 -- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f317c0c6f30 msgr2=0x7f317c154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f317c0c6f30 0x7f317c154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.454+0000 7f3181d72640 1 -- 172.21.15.103:0/339611548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c149c50 con 0x7f317c070bc0 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.455+0000 7f3181d72640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f317c070bc0 0x7f317c073620 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f317800c4b0 tx=0x7f317800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.455+0000 7f31727fc640 1 -- 172.21.15.103:0/339611548 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178017070 con 0x7f317c070bc0 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.455+0000 7f31727fc640 1 -- 172.21.15.103:0/339611548 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3178005ce0 con 0x7f317c070bc0 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.455+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c149f30 con 0x7f317c070bc0 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.455+0000 7f31727fc640 1 -- 172.21.15.103:0/339611548 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178007270 con 0x7f317c070bc0 2024-09-19T05:38:26.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.455+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c074380 con 0x7f317c070bc0 2024-09-19T05:38:26.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.456+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317c068790 con 0x7f317c070bc0 2024-09-19T05:38:26.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.456+0000 7f31727fc640 1 -- 172.21.15.103:0/339611548 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f317801a070 con 0x7f317c070bc0 2024-09-19T05:38:26.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.457+0000 7f31727fc640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f316006c2b0 0x7f316006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:26.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.457+0000 7f3181571640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f316006c2b0 0x7f316006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:26.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.457+0000 7f31727fc640 1 -- 172.21.15.103:0/339611548 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f317808a9c0 con 0x7f317c070bc0 2024-09-19T05:38:26.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.457+0000 7f3181571640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f316006c2b0 0x7f316006e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f317c14f0d0 tx=0x7f316c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:26.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.461+0000 7f31727fc640 1 -- 172.21.15.103:0/339611548 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f317808ce20 con 0x7f317c070bc0 2024-09-19T05:38:26.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.661+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f317c14f100 con 0x7f317c070bc0 2024-09-19T05:38:26.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.661+0000 7f31727fc640 1 -- 172.21.15.103:0/339611548 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6961 (secure 0 0 0) 0x7f3178058770 con 0x7f317c070bc0 2024-09-19T05:38:26.664 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:26.664 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-09-19T05:38:23:941117+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:23.941098+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4299,4296,4302,4276]},"id":1}]} 2024-09-19T05:38:26.664 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f316006c2b0 msgr2=0x7f316006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f316006c2b0 0x7f316006e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f317c14f0d0 tx=0x7f316c009190 comp rx=0 tx=0).stop 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f317c070bc0 msgr2=0x7f317c073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f317c070bc0 0x7f317c073620 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f317800c4b0 tx=0x7f317800c970 comp rx=0 tx=0).stop 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 shutdown_connections 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f316006c2b0 0x7f316006e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f317c0c7310 0x7f317c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f317c0c6f30 0x7f317c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 --2- 172.21.15.103:0/339611548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f317c070bc0 0x7f317c073620 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:26.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 >> 172.21.15.103:0/339611548 conn(0x7f317c06cd20 msgr2=0x7f317c14dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:26.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 shutdown_connections 2024-09-19T05:38:26.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:26.663+0000 7f3183fd6640 1 -- 172.21.15.103:0/339611548 wait complete. 2024-09-19T05:38:27.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:43.118180+0000', 'modified': '2024-09-19T05:38:23.941098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4302, 'mds_1': 4299, 'mds_2': 4296, 'mds_3': 4276, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'b', 'rank': 4, 'incarnation': 17, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.174:6835/623456066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6833', 'nonce': 623456066}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 623456066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'f', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.174:6837/604425908', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 604425908}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 604425908}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4296': {'gid': 4296, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6836/2341226700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 2341226700}, {'type': 'v1', 'addr': '172.21.15.103:6836', 'nonce': 2341226700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4299': {'gid': 4299, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.103:6837/2009898073', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 2009898073}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 2009898073}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4302': {'gid': 4302, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6839/2567820767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 2567820767}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 2567820767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4302, 'qdb_cluster': [4299, 4296, 4302, 4276]} 2024-09-19T05:38:27.280 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4241:up:creating 2024-09-19T05:38:28.282 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:28.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.392+0000 7f856ad11640 1 Processor -- start 2024-09-19T05:38:28.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.392+0000 7f856ad11640 1 -- start start 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f856ad11640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8564151ea0 0x7f85640c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f856ad11640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85640c3a50 0x7f856406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f856ad11640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f856415bc80 con 0x7f85640c46c0 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f856ad11640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f85641585a0 con 0x7f85640c3a50 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f856ad11640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8564157c70 con 0x7f8564151ea0 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f8568aad640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8564151ea0 0x7f85640c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f85692ae640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85640c3a50 0x7f856406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f8563fff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f85640c46c0 0x7f8564158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:35806/0 (socket says 172.21.15.103:35806) 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f85692ae640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85640c3a50 0x7f856406eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:48180/0 (socket says 172.21.15.103:48180) 2024-09-19T05:38:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f8563fff640 1 -- 172.21.15.103:0/3380415955 learned_addr learned my addr 172.21.15.103:0/3380415955 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:28.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f8568aad640 1 --2- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8564151ea0 0x7f85640c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:47622/0 (socket says 172.21.15.103:47622) 2024-09-19T05:38:28.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f85692ae640 1 -- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8564151ea0 msgr2=0x7f85640c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:28.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f85692ae640 1 --2- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8564151ea0 0x7f85640c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f85692ae640 1 -- 172.21.15.103:0/3380415955 >> v1:172.21.15.174:6789/0 conn(0x7f85640c46c0 legacy=0x7f8564158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f85692ae640 1 -- 172.21.15.103:0/3380415955 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8564157f50 con 0x7f85640c3a50 2024-09-19T05:38:28.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.393+0000 7f8568aad640 1 --2- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8564151ea0 0x7f85640c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:28.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.394+0000 7f85692ae640 1 --2- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 0x7f856406eed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f854c00ba40 tx=0x7f854c02c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ecf49b0bab562e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.394+0000 7f85637fe640 1 -- 172.21.15.103:0/3380415955 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c0327d0 con 0x7f85640c3a50 2024-09-19T05:38:28.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.394+0000 7f85637fe640 1 -- 172.21.15.103:0/3380415955 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c038070 con 0x7f85640c3a50 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.394+0000 7f85637fe640 1 -- 172.21.15.103:0/3380415955 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c032b90 con 0x7f85640c3a50 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 -- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 msgr2=0x7f856406eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 --2- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 0x7f856406eed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f854c00ba40 tx=0x7f854c02c8d0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 -- 172.21.15.103:0/3380415955 shutdown_connections 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 --2- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 0x7f856406eed0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 --2- 172.21.15.103:0/3380415955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8564151ea0 0x7f85640c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 -- 172.21.15.103:0/3380415955 >> 172.21.15.103:0/3380415955 conn(0x7f85640c9230 msgr2=0x7f85640c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 -- 172.21.15.103:0/3380415955 shutdown_connections 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.395+0000 7f856ad11640 1 -- 172.21.15.103:0/3380415955 wait complete. 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.396+0000 7f856ad11640 1 Processor -- start 2024-09-19T05:38:28.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.396+0000 7f856ad11640 1 -- start start 2024-09-19T05:38:28.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f856ad11640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 0x7f85641478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f856ad11640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85640c46c0 0x7f85640cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f856ad11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564151ea0 0x7f85640c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f856ad11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85641596e0 con 0x7f8564151ea0 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f856ad11640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8564152280 con 0x7f85640c3a50 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f856ad11640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8564158a30 con 0x7f85640c46c0 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564151ea0 0x7f85640c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564151ea0 0x7f85640c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60236/0 (socket says 172.21.15.103:60236) 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 -- 172.21.15.103:0/2737940122 learned_addr learned my addr 172.21.15.103:0/2737940122 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f8563fff640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85640c46c0 0x7f85640cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f8568aad640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 0x7f85641478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 -- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85640c46c0 msgr2=0x7f85640cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85640c46c0 0x7f85640cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 -- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 msgr2=0x7f85641478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 0x7f85641478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.397+0000 7f85692ae640 1 -- 172.21.15.103:0/2737940122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85641e5c30 con 0x7f8564151ea0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.398+0000 7f85692ae640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564151ea0 0x7f85640c5c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f854c00ba40 tx=0x7f854c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.398+0000 7f85617fa640 1 -- 172.21.15.103:0/2737940122 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c033a20 con 0x7f8564151ea0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.398+0000 7f85617fa640 1 -- 172.21.15.103:0/2737940122 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c033be0 con 0x7f8564151ea0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.398+0000 7f85617fa640 1 -- 172.21.15.103:0/2737940122 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c046410 con 0x7f8564151ea0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.398+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85641e4060 con 0x7f8564151ea0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.398+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85641f4ec0 con 0x7f8564151ea0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.399+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856415bf20 con 0x7f8564151ea0 2024-09-19T05:38:28.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.399+0000 7f85617fa640 1 -- 172.21.15.103:0/2737940122 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f854c044020 con 0x7f8564151ea0 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.400+0000 7f85617fa640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f854406c2b0 0x7f854406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.400+0000 7f85617fa640 1 -- 172.21.15.103:0/2737940122 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f854c0ac4c0 con 0x7f8564151ea0 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.400+0000 7f8568aad640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f854406c2b0 0x7f854406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:28.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.400+0000 7f8568aad640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f854406c2b0 0x7f854406e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f855c009560 tx=0x7f855c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:28.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.404+0000 7f85617fa640 1 -- 172.21.15.103:0/2737940122 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f854c07a270 con 0x7f8564151ea0 2024-09-19T05:38:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.604+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85640cd380 con 0x7f8564151ea0 2024-09-19T05:38:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.604+0000 7f85617fa640 1 -- 172.21.15.103:0/2737940122 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6961 (secure 0 0 0) 0x7f854c07e570 con 0x7f8564151ea0 2024-09-19T05:38:28.607 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:28.607 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-09-19T05:38:23:941117+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:23.941098+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4299,4296,4302,4276]},"id":1}]} 2024-09-19T05:38:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-09-19T05:38:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f854406c2b0 msgr2=0x7f854406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f854406c2b0 0x7f854406e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f855c009560 tx=0x7f855c009190 comp rx=0 tx=0).stop 2024-09-19T05:38:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564151ea0 msgr2=0x7f85640c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564151ea0 0x7f85640c5c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f854c00ba40 tx=0x7f854c004730 comp rx=0 tx=0).stop 2024-09-19T05:38:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 shutdown_connections 2024-09-19T05:38:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f854406c2b0 0x7f854406e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564151ea0 0x7f85640c5c20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85640c46c0 0x7f85640cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 --2- 172.21.15.103:0/2737940122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85640c3a50 0x7f85641478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.606+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 >> 172.21.15.103:0/2737940122 conn(0x7f85640c9230 msgr2=0x7f85640c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.607+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 shutdown_connections 2024-09-19T05:38:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:28.607+0000 7f856ad11640 1 -- 172.21.15.103:0/2737940122 wait complete. 2024-09-19T05:38:28.762 INFO:tasks.ceph.mds.e.smithi103.stderr:2024-09-19T05:38:28.760+0000 7f69a286b640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-19T05:38:29.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:43.118180+0000', 'modified': '2024-09-19T05:38:23.941098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4302, 'mds_1': 4299, 'mds_2': 4296, 'mds_3': 4276, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'b', 'rank': 4, 'incarnation': 17, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.174:6835/623456066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6833', 'nonce': 623456066}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 623456066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'f', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.174:6837/604425908', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 604425908}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 604425908}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4296': {'gid': 4296, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6836/2341226700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 2341226700}, {'type': 'v1', 'addr': '172.21.15.103:6836', 'nonce': 2341226700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4299': {'gid': 4299, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.103:6837/2009898073', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 2009898073}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 2009898073}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4302': {'gid': 4302, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6839/2567820767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 2567820767}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 2567820767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4302, 'qdb_cluster': [4299, 4296, 4302, 4276]} 2024-09-19T05:38:29.225 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4241:up:creating 2024-09-19T05:38:30.225 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.334+0000 7f5765401640 1 Processor -- start 2024-09-19T05:38:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.334+0000 7f5765401640 1 -- start start 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f5765401640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f576006cf90 0x7f5760154b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f5765401640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760071a80 0x7f57601550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f5765401640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f576006d370 0x7f5760070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f5765401640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f576015b060 con 0x7f576006d370 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f5765401640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f576015b340 con 0x7f576006cf90 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f5765401640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f576015b620 con 0x7f5760071a80 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f576006d370 0x7f5760070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f576006d370 0x7f5760070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60248/0 (socket says 172.21.15.103:60248) 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 -- 172.21.15.103:0/3315179801 learned_addr learned my addr 172.21.15.103:0/3315179801 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575effd640 1 --2- 172.21.15.103:0/3315179801 >> v2:172.21.15.174:3300/0 conn(0x7f576006cf90 0x7f5760154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f57567fc640 1 --2- 172.21.15.103:0/3315179801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760071a80 0x7f57601550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 -- 172.21.15.103:0/3315179801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760071a80 msgr2=0x7f57601550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 --2- 172.21.15.103:0/3315179801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760071a80 0x7f57601550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 -- 172.21.15.103:0/3315179801 >> v2:172.21.15.174:3300/0 conn(0x7f576006cf90 msgr2=0x7f5760154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 --2- 172.21.15.103:0/3315179801 >> v2:172.21.15.174:3300/0 conn(0x7f576006cf90 0x7f5760154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.335+0000 7f575f7fe640 1 -- 172.21.15.103:0/3315179801 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576015b900 con 0x7f576006d370 2024-09-19T05:38:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.336+0000 7f575f7fe640 1 --2- 172.21.15.103:0/3315179801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f5760070a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5760070420 tx=0x7f575802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b18eee377a750b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.336+0000 7f575e7fc640 1 -- 172.21.15.103:0/3315179801 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758036070 con 0x7f576006d370 2024-09-19T05:38:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.336+0000 7f575e7fc640 1 -- 172.21.15.103:0/3315179801 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758031600 con 0x7f576006d370 2024-09-19T05:38:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.336+0000 7f575e7fc640 1 -- 172.21.15.103:0/3315179801 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57580319d0 con 0x7f576006d370 2024-09-19T05:38:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 -- 172.21.15.103:0/3315179801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 msgr2=0x7f5760070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 --2- 172.21.15.103:0/3315179801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f5760070a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5760070420 tx=0x7f575802a730 comp rx=0 tx=0).stop 2024-09-19T05:38:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 -- 172.21.15.103:0/3315179801 shutdown_connections 2024-09-19T05:38:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 --2- 172.21.15.103:0/3315179801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f5760070a90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 --2- 172.21.15.103:0/3315179801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760071a80 0x7f57601550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 --2- 172.21.15.103:0/3315179801 >> v2:172.21.15.174:3300/0 conn(0x7f576006cf90 0x7f5760154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 -- 172.21.15.103:0/3315179801 >> 172.21.15.103:0/3315179801 conn(0x7f57600ce410 msgr2=0x7f57600ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:30.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 -- 172.21.15.103:0/3315179801 shutdown_connections 2024-09-19T05:38:30.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.337+0000 7f5765401640 1 -- 172.21.15.103:0/3315179801 wait complete. 2024-09-19T05:38:30.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.338+0000 7f5765401640 1 Processor -- start 2024-09-19T05:38:30.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.338+0000 7f5765401640 1 -- start start 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f5765401640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576006cf90 0x7f57601f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f5765401640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f57601f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f5765401640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5760071a80 0x7f57601e5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f5765401640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f576015ad50 con 0x7f576006d370 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f5765401640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5760070570 con 0x7f5760071a80 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f5765401640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f57600c9ee0 con 0x7f576006cf90 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f57601f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f575effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576006cf90 0x7f57601f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f57601f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60264/0 (socket says 172.21.15.103:60264) 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f575f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5760071a80 0x7f57601e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 -- 172.21.15.103:0/3391705585 learned_addr learned my addr 172.21.15.103:0/3391705585 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 -- 172.21.15.103:0/3391705585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576006cf90 msgr2=0x7f57601f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576006cf90 0x7f57601f4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 -- 172.21.15.103:0/3391705585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5760071a80 msgr2=0x7f57601e5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5760071a80 0x7f57601e5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.339+0000 7f57567fc640 1 -- 172.21.15.103:0/3391705585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5760155910 con 0x7f576006d370 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.340+0000 7f57567fc640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f57601f1990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f574800d620 tx=0x7f574800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.340+0000 7f5757fff640 1 -- 172.21.15.103:0/3391705585 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574800b620 con 0x7f576006d370 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.340+0000 7f5757fff640 1 -- 172.21.15.103:0/3391705585 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5748019070 con 0x7f576006d370 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.340+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5760155bf0 con 0x7f576006d370 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.340+0000 7f5757fff640 1 -- 172.21.15.103:0/3391705585 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574800ba00 con 0x7f576006d370 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.340+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57600c90c0 con 0x7f576006d370 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.341+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57600c9780 con 0x7f576006d370 2024-09-19T05:38:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.341+0000 7f5757fff640 1 -- 172.21.15.103:0/3391705585 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f574800bba0 con 0x7f576006d370 2024-09-19T05:38:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.342+0000 7f5757fff640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f574006c2b0 0x7f574006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.342+0000 7f5757fff640 1 -- 172.21.15.103:0/3391705585 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f574808bb70 con 0x7f576006d370 2024-09-19T05:38:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.342+0000 7f575effd640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f574006c2b0 0x7f574006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.342+0000 7f575effd640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f574006c2b0 0x7f574006e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5750006fd0 tx=0x7f5750008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.346+0000 7f5757fff640 1 -- 172.21.15.103:0/3391705585 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5748059810 con 0x7f576006d370 2024-09-19T05:38:30.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.543+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57600c9350 con 0x7f576006d370 2024-09-19T05:38:30.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.543+0000 7f5757fff640 1 -- 172.21.15.103:0/3391705585 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6965 (secure 0 0 0) 0x7f574805db10 con 0x7f576006d370 2024-09-19T05:38:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:30.546 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":18,"btime":"2024-09-19T05:38:28:967859+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:28.967854+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4241,4276,4302,4296,4299]},"id":1}]} 2024-09-19T05:38:30.546 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 18 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f574006c2b0 msgr2=0x7f574006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f574006c2b0 0x7f574006e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5750006fd0 tx=0x7f5750008040 comp rx=0 tx=0).stop 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 msgr2=0x7f57601f1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f57601f1990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f574800d620 tx=0x7f574800dae0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 shutdown_connections 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f574006c2b0 0x7f574006e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5760071a80 0x7f57601e5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f576006d370 0x7f57601f1990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 --2- 172.21.15.103:0/3391705585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576006cf90 0x7f57601f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 >> 172.21.15.103:0/3391705585 conn(0x7f57600ce410 msgr2=0x7f5760154930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 shutdown_connections 2024-09-19T05:38:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:30.545+0000 7f5765401640 1 -- 172.21.15.103:0/3391705585 wait complete. 2024-09-19T05:38:31.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:37:43.118180+0000', 'modified': '2024-09-19T05:38:28.967854+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4302, 'mds_1': 4299, 'mds_2': 4296, 'mds_3': 4276, 'mds_4': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'b', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.174:6835/623456066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6833', 'nonce': 623456066}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 623456066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'f', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.174:6837/604425908', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 604425908}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 604425908}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4296': {'gid': 4296, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6836/2341226700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 2341226700}, {'type': 'v1', 'addr': '172.21.15.103:6836', 'nonce': 2341226700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4299': {'gid': 4299, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.103:6837/2009898073', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 2009898073}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 2009898073}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4302': {'gid': 4302, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6839/2567820767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 2567820767}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 2567820767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4302, 'qdb_cluster': [4241, 4276, 4302, 4296, 4299]} 2024-09-19T05:38:31.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T05:38:31.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-19T05:38:31.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.266+0000 7f39e9ae4640 1 Processor -- start 2024-09-19T05:38:31.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.266+0000 7f39e9ae4640 1 -- start start 2024-09-19T05:38:31.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e9ae4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f39e40cd380 0x7f39e40cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e9ae4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39e415af20 0x7f39e415b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e9ae4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e40cbea0 con 0x7f39e40ccd60 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e9ae4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f39e415b890 con 0x7f39e415af20 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e9ae4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f39e40cb8f0 con 0x7f39e40cd380 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e3fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39e415af20 0x7f39e415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e2ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f39e40ccd60 0x7f39e40b4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40796/0 (socket says 172.21.15.103:40796) 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e2ffd640 1 -- 172.21.15.103:0/3834754779 learned_addr learned my addr 172.21.15.103:0/3834754779 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e37fe640 1 --2- 172.21.15.103:0/3834754779 >> v2:172.21.15.174:3300/0 conn(0x7f39e40cd380 0x7f39e40cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e3fff640 1 -- 172.21.15.103:0/3834754779 >> v2:172.21.15.174:3300/0 conn(0x7f39e40cd380 msgr2=0x7f39e40cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e3fff640 1 --2- 172.21.15.103:0/3834754779 >> v2:172.21.15.174:3300/0 conn(0x7f39e40cd380 0x7f39e40cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e3fff640 1 -- 172.21.15.103:0/3834754779 >> v1:172.21.15.103:6789/0 conn(0x7f39e40ccd60 legacy=0x7f39e40b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e3fff640 1 -- 172.21.15.103:0/3834754779 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e40cbbc0 con 0x7f39e415af20 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.267+0000 7f39e27fc640 1 -- 172.21.15.103:0/3834754779 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950296754 0 0) 0x7f39e40cbea0 con 0x7f39e40ccd60 2024-09-19T05:38:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.268+0000 7f39e3fff640 1 --2- 172.21.15.103:0/3834754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e415af20 0x7f39e415b350 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39e408e490 tx=0x7f39dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7634bce329bb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.268+0000 7f39e27fc640 1 -- 172.21.15.103:0/3834754779 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc007740 con 0x7f39e415af20 2024-09-19T05:38:31.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.268+0000 7f39e27fc640 1 -- 172.21.15.103:0/3834754779 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc0078e0 con 0x7f39e415af20 2024-09-19T05:38:31.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.268+0000 7f39e27fc640 1 -- 172.21.15.103:0/3834754779 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc007cb0 con 0x7f39e415af20 2024-09-19T05:38:31.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 -- 172.21.15.103:0/3834754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e415af20 msgr2=0x7f39e415b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/3834754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e415af20 0x7f39e415b350 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39e408e490 tx=0x7f39dc02a710 comp rx=0 tx=0).stop 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 -- 172.21.15.103:0/3834754779 shutdown_connections 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/3834754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e415af20 0x7f39e415b350 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/3834754779 >> v2:172.21.15.174:3300/0 conn(0x7f39e40cd380 0x7f39e40cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 -- 172.21.15.103:0/3834754779 >> 172.21.15.103:0/3834754779 conn(0x7f39e406d830 msgr2=0x7f39e406dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 -- 172.21.15.103:0/3834754779 shutdown_connections 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.269+0000 7f39e9ae4640 1 -- 172.21.15.103:0/3834754779 wait complete. 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.270+0000 7f39e9ae4640 1 Processor -- start 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.270+0000 7f39e9ae4640 1 -- start start 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e40ccd60 0x7f39e41f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e40cd380 0x7f39e414cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e415af20 0x7f39e4149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40c6d40 con 0x7f39e40ccd60 2024-09-19T05:38:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40c6a60 con 0x7f39e415af20 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f39e40c7020 con 0x7f39e40cd380 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e40ccd60 0x7f39e41f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e40ccd60 0x7f39e41f5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56874/0 (socket says 172.21.15.103:56874) 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 -- 172.21.15.103:0/29162606 learned_addr learned my addr 172.21.15.103:0/29162606 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e3fff640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e415af20 0x7f39e4149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e40cd380 0x7f39e414cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 -- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e40cd380 msgr2=0x7f39e414cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e40cd380 0x7f39e414cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 -- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e415af20 msgr2=0x7f39e4149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e415af20 0x7f39e4149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 -- 172.21.15.103:0/29162606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e41493c0 con 0x7f39e40ccd60 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e37fe640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e40ccd60 0x7f39e41f5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39d400d830 tx=0x7f39d400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39cbfff640 1 -- 172.21.15.103:0/29162606 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d400b6c0 con 0x7f39e40ccd60 2024-09-19T05:38:31.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39cbfff640 1 -- 172.21.15.103:0/29162606 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4019070 con 0x7f39e40ccd60 2024-09-19T05:38:31.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39cbfff640 1 -- 172.21.15.103:0/29162606 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d400ba80 con 0x7f39e40ccd60 2024-09-19T05:38:31.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e41f5690 con 0x7f39e40ccd60 2024-09-19T05:38:31.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.271+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e41f4950 con 0x7f39e40ccd60 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.273+0000 7f39cbfff640 1 -- 172.21.15.103:0/29162606 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f39d401e460 con 0x7f39e40ccd60 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.273+0000 7f39cbfff640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f39d006c2b0 0x7f39d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.273+0000 7f39cbfff640 1 -- 172.21.15.103:0/29162606 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f39d408bd90 con 0x7f39e40ccd60 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.273+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f39d006c2b0 0x7f39d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.274+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f39d006c2b0 0x7f39d006e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f39e40b5c30 tx=0x7f39d8007b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.274+0000 7f39ec885740 1 Processor -- start 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.274+0000 7f39ec885740 1 -- start start 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5aa029e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9c7f80 0x55ac5aa02f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39ec885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9cab30 0x55ac5a9c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39ec885740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac5a92b520 con 0x55ac5a9cab30 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ac5a8d33e0 con 0x55ac5a9ca750 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55ac5a9274e0 con 0x55ac5a9c7f80 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9cab30 0x55ac5a9c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9cab30 0x55ac5a9c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56890/0 (socket says 172.21.15.103:56890) 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39e3fff640 1 -- 172.21.15.103:0/3699647439 learned_addr learned my addr 172.21.15.103:0/3699647439 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39e37fe640 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5aa029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.275+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9c7f80 0x55ac5aa02f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39e3fff640 1 -- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9c7f80 msgr2=0x55ac5aa02f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39e3fff640 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9c7f80 0x55ac5aa02f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39e3fff640 1 -- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 msgr2=0x55ac5aa029e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39e3fff640 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5aa029e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39e3fff640 1 -- 172.21.15.103:0/3699647439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5a8ee2f0 con 0x55ac5a9cab30 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39e3fff640 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9cab30 0x55ac5a9c6a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009e50 tx=0x7f39dc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a958badf5b529b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39c97fa640 1 -- 172.21.15.103:0/3699647439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc007740 con 0x55ac5a9cab30 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39c97fa640 1 -- 172.21.15.103:0/3699647439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc0078e0 con 0x55ac5a9cab30 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.276+0000 7f39c97fa640 1 -- 172.21.15.103:0/3699647439 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc007c90 con 0x55ac5a9cab30 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 -- 172.21.15.103:0/3699647439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9cab30 msgr2=0x55ac5a9c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9cab30 0x55ac5a9c6a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009e50 tx=0x7f39dc02e000 comp rx=0 tx=0).stop 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 -- 172.21.15.103:0/3699647439 shutdown_connections 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9cab30 0x55ac5a9c6a60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9c7f80 0x55ac5aa02f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 --2- 172.21.15.103:0/3699647439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5aa029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 -- 172.21.15.103:0/3699647439 >> 172.21.15.103:0/3699647439 conn(0x55ac5a9c8e70 msgr2=0x55ac5a9c9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 -- 172.21.15.103:0/3699647439 shutdown_connections 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 -- 172.21.15.103:0/3699647439 wait complete. 2024-09-19T05:38:31.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 -- start start 2024-09-19T05:38:31.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.277+0000 7f39ec885740 1 Processor -- start 2024-09-19T05:38:31.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39ec885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5aa19da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9ee430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9ed110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39ec885740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac5a9c9fe0 con 0x55ac5a9c7f80 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ac5a8b4450 con 0x55ac5a9ca750 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55ac5aa02550 con 0x55ac5a9cab30 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5aa19da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39ec885740 10 client.0 _ll_register_callbacks cb 0x55ac5a63dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5aa19da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56894/0 (socket says 172.21.15.103:56894) 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e37fe640 1 -- 172.21.15.103:0/1319837514 learned_addr learned my addr 172.21.15.103:0/1319837514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9ee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e3fff640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e37fe640 1 -- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 msgr2=0x55ac5a9ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9ed110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e37fe640 1 -- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 msgr2=0x55ac5a9ee430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.278+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9ee430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39e37fe640 1 -- 172.21.15.103:0/1319837514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5a63e2d0 con 0x55ac5a9c7f80 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39e3fff640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5aa19da0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f39d400b4b0 tx=0x7f39d405a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37b9d9f436745f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39c27fc640 1 -- 172.21.15.103:0/1319837514 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4071020 con 0x55ac5a9c7f80 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39dc0078e0 con 0x55ac5a9c7f80 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39c27fc640 1 -- 172.21.15.103:0/1319837514 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f39d40600b0 con 0x55ac5a9c7f80 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39c27fc640 1 -- 172.21.15.103:0/1319837514 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f39d4062670 con 0x55ac5a9c7f80 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 10 client.4764 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ac5a7086b0 con 0x55ac5a9c7f80 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39c27fc640 1 -- 172.21.15.103:0/1319837514 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc0078e0 con 0x55ac5a9c7f80 2024-09-19T05:38:31.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39c27fc640 1 -- 172.21.15.103:0/1319837514 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f39d4013070 con 0x55ac5a9c7f80 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 10 client.4764 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 10 client.4764 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 20 client.4764 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 0x55ac5a9ed650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 4 client.4764 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 --> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac5a938c50 con 0x55ac5a9fae60 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.279+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 0x55ac5a9ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.280+0000 7f39e2ffd640 1 -- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 msgr2=0x55ac5a9ed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.280+0000 7f39e2ffd640 1 -- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 msgr2=0x55ac5a9ed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.280+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 0x55ac5a9ed650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:38:31.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.280+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 0x55ac5a9ed650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:31.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.481+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 0x55ac5a9ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:31.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.481+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 0x55ac5a9ed650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89dfbd92d8b15e76 server_cookie=2695b95dc5231867 in_seq=0 out_seq=0 2024-09-19T05:38:31.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:31.481+0000 7f39c27fc640 10 client.4764 ms_handle_connect on v2:172.21.15.174:6833/623456066 2024-09-19T05:38:33.762 INFO:tasks.ceph.mds.e.smithi103.stderr:2024-09-19T05:38:33.760+0000 7f69a286b640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-19T05:38:33.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39c27fc640 1 -- 172.21.15.103:0/1319837514 <== mds.4 v2:172.21.15.174:6833/623456066 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac5a938c50 con 0x55ac5a9fae60 2024-09-19T05:38:33.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39c27fc640 10 client.4764 handle_command_reply: tid=0 2024-09-19T05:38:33.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 client.4764 shutdown 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 msgr2=0x55ac5aa19da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5aa19da0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f39d400b4b0 tx=0x7f39d405a2c0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 shutdown_connections 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5a9fae60 0x55ac5a9ed650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9ee430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 --2- 172.21.15.103:0/1319837514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5aa19da0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39c27fc640 0 client.4764 ms_handle_reset on v2:172.21.15.174:6833/623456066 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 >> 172.21.15.103:0/1319837514 conn(0x55ac5a9c8e70 msgr2=0x55ac5aa02950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 shutdown_connections 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.974+0000 7f39ec885740 1 -- 172.21.15.103:0/1319837514 wait complete. 2024-09-19T05:38:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.975+0000 7f39ec885740 20 client.4764 trim_cache size 0 max 16384 2024-09-19T05:38:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.994+0000 7f39ec885740 1 Processor -- start 2024-09-19T05:38:33.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.994+0000 7f39ec885740 1 -- start start 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39ec885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9eff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39ec885740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39e41477d0 con 0x55ac5a9c7f80 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ac5aa1a340 con 0x55ac5a9ca750 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55ac5aa01d00 con 0x55ac5a9cab30 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9eff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56910/0 (socket says 172.21.15.103:56910) 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.995+0000 7f39e37fe640 1 -- 172.21.15.103:0/1550106153 learned_addr learned my addr 172.21.15.103:0/1550106153 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e3fff640 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:33.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e37fe640 1 -- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 msgr2=0x55ac5a9c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e37fe640 1 -- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 msgr2=0x55ac5a9bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9bf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e37fe640 1 -- 172.21.15.103:0/1550106153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5aa17bb0 con 0x55ac5a9c7f80 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9eff20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f39d4000c00 tx=0x7f39d405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9765287486f3b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39c8ff9640 1 -- 172.21.15.103:0/1550106153 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4071070 con 0x55ac5a9c7f80 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39c8ff9640 1 -- 172.21.15.103:0/1550106153 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4056100 con 0x55ac5a9c7f80 2024-09-19T05:38:34.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.996+0000 7f39c8ff9640 1 -- 172.21.15.103:0/1550106153 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4058ee0 con 0x55ac5a9c7f80 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 -- 172.21.15.103:0/1550106153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 msgr2=0x55ac5a9eff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9eff20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f39d4000c00 tx=0x7f39d405c000 comp rx=0 tx=0).stop 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 -- 172.21.15.103:0/1550106153 shutdown_connections 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5a9c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 --2- 172.21.15.103:0/1550106153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9eff20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 -- 172.21.15.103:0/1550106153 >> 172.21.15.103:0/1550106153 conn(0x55ac5a9c8e70 msgr2=0x55ac5a9c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 -- 172.21.15.103:0/1550106153 shutdown_connections 2024-09-19T05:38:34.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.997+0000 7f39ec885740 1 -- 172.21.15.103:0/1550106153 wait complete. 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.998+0000 7f39ec885740 1 -- start start 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.998+0000 7f39ec885740 1 Processor -- start 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39ec885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39ec885740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5aa0ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39ec885740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac5a9fd780 con 0x55ac5a9c7f80 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ac5a9ee9c0 con 0x55ac5a9ca750 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39ec885740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55ac5a9edba0 con 0x55ac5a9cab30 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39ec885740 10 client.0 _ll_register_callbacks cb 0x7f39d4006d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9fdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56918/0 (socket says 172.21.15.103:56918) 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 -- 172.21.15.103:0/1327177647 learned_addr learned my addr 172.21.15.103:0/1327177647 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e3fff640 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5aa0ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 -- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 msgr2=0x55ac5aa0ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5aa0ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 -- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 msgr2=0x55ac5a9c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 -- 172.21.15.103:0/1327177647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5a9fe000 con 0x55ac5a9c7f80 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39e37fe640 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9fdac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39d405efd0 tx=0x7f39d4055e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f7409aa78b7e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:33.999+0000 7f39c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39c27fc640 1 -- 172.21.15.103:0/1327177647 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d40602b0 con 0x55ac5a9c7f80 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39c27fc640 1 -- 172.21.15.103:0/1327177647 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f39d4058ee0 con 0x55ac5a9c7f80 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d4056100 con 0x55ac5a9c7f80 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39c27fc640 1 -- 172.21.15.103:0/1327177647 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f39d40590e0 con 0x55ac5a9c7f80 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 10 client.4770 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ac5aa06240 con 0x55ac5a9c7f80 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39c27fc640 1 -- 172.21.15.103:0/1327177647 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4056100 con 0x55ac5a9c7f80 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39c27fc640 1 -- 172.21.15.103:0/1327177647 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f39d40557e0 con 0x55ac5a9c7f80 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 10 client.4770 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 10 client.4770 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 20 client.4770 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5aa81df0 0x55ac5aa821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 4 client.4770 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 --> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] -- command(tid 0: {"prefix": "status"}) -- 0x55ac5a932fa0 con 0x55ac5aa81df0 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.000+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5aa81df0 0x55ac5aa821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39c27fc640 10 client.4770 ms_handle_connect on v2:172.21.15.174:6833/623456066 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39e2ffd640 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5aa81df0 0x55ac5aa821d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cbe104e9149207f8 server_cookie=9d2ac84652dc64a3 in_seq=0 out_seq=0 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39c27fc640 1 -- 172.21.15.103:0/1327177647 <== mds.4 v2:172.21.15.174:6833/623456066 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ac5a932fa0 con 0x55ac5aa81df0 2024-09-19T05:38:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39c27fc640 10 client.4770 handle_command_reply: tid=0 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 client.4770 shutdown 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 msgr2=0x55ac5a9fdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9fdac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39d405efd0 tx=0x7f39d4055e60 comp rx=0 tx=0).stop 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 shutdown_connections 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:6833/623456066,v1:172.21.15.174:6835/623456066] conn(0x55ac5aa81df0 0x55ac5aa821d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55ac5a9cab30 0x55ac5aa0ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac5a9ca750 0x55ac5a9c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39c27fc640 0 client.4770 ms_handle_reset on v2:172.21.15.174:6833/623456066 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 --2- 172.21.15.103:0/1327177647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac5a9c7f80 0x55ac5a9fdac0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 >> 172.21.15.103:0/1327177647 conn(0x55ac5a9c8e70 msgr2=0x55ac5a9c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 shutdown_connections 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.001+0000 7f39ec885740 1 -- 172.21.15.103:0/1327177647 wait complete. 2024-09-19T05:38:34.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39ec885740 20 client.4770 trim_cache size 0 max 16384 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 4, 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4241, 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 10.057633490000001, 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 18, 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 28, 2024-09-19T05:38:34.010 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 28, 2024-09-19T05:38:34.011 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 56.240345638999997 2024-09-19T05:38:34.011 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:34.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f39d006c2b0 msgr2=0x7f39d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f39d006c2b0 0x7f39d006e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f39e40b5c30 tx=0x7f39d8007b70 comp rx=0 tx=0).stop 2024-09-19T05:38:34.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e40ccd60 msgr2=0x7f39e41f5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e40ccd60 0x7f39e41f5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39d400d830 tx=0x7f39d400dcf0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 shutdown_connections 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f39d006c2b0 0x7f39d006e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e415af20 0x7f39e4149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e40cd380 0x7f39e414cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 --2- 172.21.15.103:0/29162606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39e40ccd60 0x7f39e41f5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 >> 172.21.15.103:0/29162606 conn(0x7f39e406d830 msgr2=0x7f39e40b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 shutdown_connections 2024-09-19T05:38:34.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.002+0000 7f39e9ae4640 1 -- 172.21.15.103:0/29162606 wait complete. 2024-09-19T05:38:34.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-19T05:38:34.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 Processor -- start 2024-09-19T05:38:34.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 -- start start 2024-09-19T05:38:34.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe4154f40 0x7fbfe40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbfe4155320 0x7fbfe40cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbfe415ed80 0x7fbfe40d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe415f1c0 con 0x7fbfe4155320 2024-09-19T05:38:34.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe40cb830 con 0x7fbfe415ed80 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.121+0000 7fbfe9728640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40cbb10 con 0x7fbfe4154f40 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbfe4155320 0x7fbfe40cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbfe4155320 0x7fbfe40cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56928/0 (socket says 172.21.15.103:56928) 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 -- 172.21.15.103:0/2747372353 learned_addr learned my addr 172.21.15.103:0/2747372353 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/2747372353 >> v2:172.21.15.174:3300/0 conn(0x7fbfe415ed80 0x7fbfe40d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/2747372353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe4154f40 0x7fbfe40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 -- 172.21.15.103:0/2747372353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe4154f40 msgr2=0x7fbfe40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/2747372353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe4154f40 0x7fbfe40c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 -- 172.21.15.103:0/2747372353 >> v2:172.21.15.174:3300/0 conn(0x7fbfe415ed80 msgr2=0x7fbfe40d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/2747372353 >> v2:172.21.15.174:3300/0 conn(0x7fbfe415ed80 0x7fbfe40d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe27fc640 1 -- 172.21.15.103:0/2747372353 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe40cbdf0 con 0x7fbfe4155320 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/2747372353 >> v2:172.21.15.174:3300/0 conn(0x7fbfe415ed80 0x7fbfe40d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:34.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.122+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/2747372353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe4154f40 0x7fbfe40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:34.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/2747372353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe4155320 0x7fbfe40cb1c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40cc560 tx=0x7fbfd802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7032dc8c784855 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe1ffb640 1 -- 172.21.15.103:0/2747372353 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8037070 con 0x7fbfe4155320 2024-09-19T05:38:34.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe1ffb640 1 -- 172.21.15.103:0/2747372353 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8032440 con 0x7fbfe4155320 2024-09-19T05:38:34.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe1ffb640 1 -- 172.21.15.103:0/2747372353 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8032810 con 0x7fbfe4155320 2024-09-19T05:38:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 -- 172.21.15.103:0/2747372353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe4155320 msgr2=0x7fbfe40cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 --2- 172.21.15.103:0/2747372353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe4155320 0x7fbfe40cb1c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40cc560 tx=0x7fbfd802a1e0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 -- 172.21.15.103:0/2747372353 shutdown_connections 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 --2- 172.21.15.103:0/2747372353 >> v2:172.21.15.174:3300/0 conn(0x7fbfe415ed80 0x7fbfe40d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 --2- 172.21.15.103:0/2747372353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe4155320 0x7fbfe40cb1c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 --2- 172.21.15.103:0/2747372353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe4154f40 0x7fbfe40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 -- 172.21.15.103:0/2747372353 >> 172.21.15.103:0/2747372353 conn(0x7fbfe406bc10 msgr2=0x7fbfe406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 -- 172.21.15.103:0/2747372353 shutdown_connections 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.123+0000 7fbfe9728640 1 -- 172.21.15.103:0/2747372353 wait complete. 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 Processor -- start 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 -- start start 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe4154f40 0x7fbfe4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe415ed80 0x7fbfe4153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe406e270 0x7fbfe41544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40d10d0 con 0x7fbfe415ed80 2024-09-19T05:38:34.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40742c0 con 0x7fbfe4154f40 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.125+0000 7fbfe9728640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40d1250 con 0x7fbfe406e270 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe415ed80 0x7fbfe4153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe415ed80 0x7fbfe4153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56944/0 (socket says 172.21.15.103:56944) 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 -- 172.21.15.103:0/3150532290 learned_addr learned my addr 172.21.15.103:0/3150532290 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe4154f40 0x7fbfe4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe406e270 0x7fbfe41544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 -- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe406e270 msgr2=0x7fbfe41544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe406e270 0x7fbfe41544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 -- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe4154f40 msgr2=0x7fbfe4158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe4154f40 0x7fbfe4158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 -- 172.21.15.103:0/3150532290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe4159a30 con 0x7fbfe415ed80 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe406e270 0x7fbfe41544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe415ed80 0x7fbfe4153f80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbfd802a220 tx=0x7fbfd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfcb7fe640 1 -- 172.21.15.103:0/3150532290 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8041020 con 0x7fbfe415ed80 2024-09-19T05:38:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfcb7fe640 1 -- 172.21.15.103:0/3150532290 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd80306c0 con 0x7fbfe415ed80 2024-09-19T05:38:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe4159d10 con 0x7fbfe415ed80 2024-09-19T05:38:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfcb7fe640 1 -- 172.21.15.103:0/3150532290 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8037040 con 0x7fbfe415ed80 2024-09-19T05:38:34.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.126+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe415a2d0 con 0x7fbfe415ed80 2024-09-19T05:38:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.128+0000 7fbfcb7fe640 1 -- 172.21.15.103:0/3150532290 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbfd8044020 con 0x7fbfe415ed80 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.128+0000 7fbfcb7fe640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbfd006c2b0 0x7fbfd006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.129+0000 7fbfcb7fe640 1 -- 172.21.15.103:0/3150532290 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbfd80ac0d0 con 0x7fbfe415ed80 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.129+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbfd006c2b0 0x7fbfd006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.129+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbfd006c2b0 0x7fbfd006e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4006fd0 tx=0x7fbfd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.129+0000 7fbfec4b7740 1 Processor -- start 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.129+0000 7fbfec4b7740 1 -- start start 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b2799e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b279f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b23da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55899b1a2520 con 0x55899b241750 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55899b14a3e0 con 0x55899b23ef80 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55899b19e4e0 con 0x55899b241b30 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfe2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b2799e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfe2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b2799e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56946/0 (socket says 172.21.15.103:56946) 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/2827367562 learned_addr learned my addr 172.21.15.103:0/2827367562 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b23da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b279f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 msgr2=0x55899b23da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.130+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b23da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 msgr2=0x55899b279f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b279f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/2827367562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899b1652f0 con 0x55899b241750 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b2799e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40109d0 tx=0x7fbfd4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1adf078be92159 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfc8ff9640 1 -- 172.21.15.103:0/2827367562 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd401c050 con 0x55899b241750 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfc8ff9640 1 -- 172.21.15.103:0/2827367562 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd4026070 con 0x55899b241750 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfc8ff9640 1 -- 172.21.15.103:0/2827367562 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400f040 con 0x55899b241750 2024-09-19T05:38:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfec4b7740 1 -- 172.21.15.103:0/2827367562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 msgr2=0x55899b2799e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.131+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b2799e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40109d0 tx=0x7fbfd4013000 comp rx=0 tx=0).stop 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 -- 172.21.15.103:0/2827367562 shutdown_connections 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b23da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b279f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/2827367562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b2799e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 -- 172.21.15.103:0/2827367562 >> 172.21.15.103:0/2827367562 conn(0x55899b23fe70 msgr2=0x55899b240270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 -- 172.21.15.103:0/2827367562 shutdown_connections 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 -- 172.21.15.103:0/2827367562 wait complete. 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 -- start start 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.132+0000 7fbfec4b7740 1 Processor -- start 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b23ef80 0x55899b267b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b241750 0x55899b2639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b271570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55899b240fe0 con 0x55899b23ef80 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55899b12b450 con 0x55899b241750 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55899b279550 con 0x55899b241b30 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfec4b7740 10 client.0 _ll_register_callbacks cb 0x55899aeb4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b23ef80 0x55899b267b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b23ef80 0x55899b267b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56954/0 (socket says 172.21.15.103:56954) 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/4206741484 learned_addr learned my addr 172.21.15.103:0/4206741484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b241750 0x55899b2639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b271570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 msgr2=0x55899b271570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b271570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b241750 msgr2=0x55899b2639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b241750 0x55899b2639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.133+0000 7fbfe2ffd640 1 -- 172.21.15.103:0/4206741484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899aeb52d0 con 0x55899b23ef80 2024-09-19T05:38:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b23ef80 0x55899b267b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4010970 tx=0x7fbfd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40099ad36d2a86c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/4206741484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4021c80 con 0x55899b23ef80 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/4206741484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbfd4035480 con 0x55899b23ef80 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfd4026070 con 0x55899b23ef80 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/4206741484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fbfd401c030 con 0x55899b23ef80 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 10 client.4782 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55899af7f6b0 con 0x55899b23ef80 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/4206741484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd4026070 con 0x55899b23ef80 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/4206741484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7fbfd4035680 con 0x55899b23ef80 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 10 client.4782 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 10 client.4782 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 20 client.4782 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b294b70 0x55899b261f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 4 client.4782 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 --> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55899b1afc50 con 0x55899b294b70 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.134+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b294b70 0x55899b261f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.135+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b294b70 0x55899b261f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c201b331f333784c server_cookie=fc2a1ca270d7435 in_seq=0 out_seq=0 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.135+0000 7fbfc1ffb640 10 client.4782 ms_handle_connect on v2:172.21.15.174:6836/604425908 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/4206741484 <== mds.3 v2:172.21.15.174:6836/604425908 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55899b1afc50 con 0x55899b294b70 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfc1ffb640 10 client.4782 handle_command_reply: tid=0 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 client.4782 shutdown 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b23ef80 msgr2=0x55899b267b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b23ef80 0x55899b267b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4010970 tx=0x7fbfd4004730 comp rx=0 tx=0).stop 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 shutdown_connections 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b271570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b241750 0x55899b2639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b294b70 0x55899b261f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/4206741484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b23ef80 0x55899b267b10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfc1ffb640 0 client.4782 ms_handle_reset on v2:172.21.15.174:6836/604425908 2024-09-19T05:38:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 >> 172.21.15.103:0/4206741484 conn(0x55899b23fe70 msgr2=0x55899b279950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 shutdown_connections 2024-09-19T05:38:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 1 -- 172.21.15.103:0/4206741484 wait complete. 2024-09-19T05:38:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.136+0000 7fbfec4b7740 20 client.4782 trim_cache size 0 max 16384 2024-09-19T05:38:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.153+0000 7fbfec4b7740 1 Processor -- start 2024-09-19T05:38:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfec4b7740 1 -- start start 2024-09-19T05:38:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b271150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b271690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b240250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe41fce00 con 0x55899b241750 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55899b263270 con 0x55899b23ef80 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55899b290fb0 con 0x55899b241b30 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfe27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b271690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfe27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b271690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56964/0 (socket says 172.21.15.103:56964) 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.154+0000 7fbfe27fc640 1 -- 172.21.15.103:0/830240656 learned_addr learned my addr 172.21.15.103:0/830240656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b271150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe27fc640 1 -- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 msgr2=0x55899b240250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b240250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe27fc640 1 -- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 msgr2=0x55899b271150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b271150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe27fc640 1 -- 172.21.15.103:0/830240656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899b23d580 con 0x55899b241750 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b271150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b271690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8079680 tx=0x7fbfd8048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b22e7007482a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfc3fff640 1 -- 172.21.15.103:0/830240656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd807e060 con 0x55899b241750 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfc3fff640 1 -- 172.21.15.103:0/830240656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8082920 con 0x55899b241750 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfc3fff640 1 -- 172.21.15.103:0/830240656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8077d50 con 0x55899b241750 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 -- 172.21.15.103:0/830240656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 msgr2=0x55899b271690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b271690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8079680 tx=0x7fbfd8048040 comp rx=0 tx=0).stop 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 -- 172.21.15.103:0/830240656 shutdown_connections 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241b30 0x55899b240250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241750 0x55899b271690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/830240656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b271150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 -- 172.21.15.103:0/830240656 >> 172.21.15.103:0/830240656 conn(0x55899b23fe70 msgr2=0x55899b23bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 -- 172.21.15.103:0/830240656 shutdown_connections 2024-09-19T05:38:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.155+0000 7fbfec4b7740 1 -- 172.21.15.103:0/830240656 wait complete. 2024-09-19T05:38:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.156+0000 7fbfec4b7740 1 -- start start 2024-09-19T05:38:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.156+0000 7fbfec4b7740 1 Processor -- start 2024-09-19T05:38:34.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b277ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241750 0x55899b2783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241b30 0x55899b2f8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55899b2949f0 con 0x55899b241b30 2024-09-19T05:38:34.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55899b2730f0 con 0x55899b23ef80 2024-09-19T05:38:34.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55899b2950c0 con 0x55899b241750 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 10 client.0 _ll_register_callbacks cb 0x7fbfd80094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241b30 0x55899b2f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241b30 0x55899b2f8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56972/0 (socket says 172.21.15.103:56972) 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 -- 172.21.15.103:0/3776163237 learned_addr learned my addr 172.21.15.103:0/3776163237 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b277ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241750 0x55899b2783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 -- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241750 msgr2=0x55899b2783a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241750 0x55899b2783a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 -- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 msgr2=0x55899b277ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b277ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 -- 172.21.15.103:0/3776163237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899b262610 con 0x55899b241b30 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe27fc640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241750 0x55899b2783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:34.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfe37fe640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241b30 0x55899b2f8770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc007d70 tx=0x7fbfdc0146f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd845cd584019f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/3776163237 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc003990 con 0x55899b241b30 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/3776163237 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbfdc003b30 con 0x55899b241b30 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.157+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfd8082920 con 0x55899b241b30 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/3776163237 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fbfdc027050 con 0x55899b241b30 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 10 client.4788 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55899b28e6d0 con 0x55899b241b30 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/3776163237 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8082920 con 0x55899b241b30 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/3776163237 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7fbfdc02a020 con 0x55899b241b30 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 10 client.4788 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 10 client.4788 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 20 client.4788 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b3091e0 0x55899b30b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 4 client.4788 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 --> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] -- command(tid 0: {"prefix": "status"}) -- 0x55899b1a9fa0 con 0x55899b3091e0 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b3091e0 0x55899b30b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfc1ffb640 10 client.4788 ms_handle_connect on v2:172.21.15.174:6836/604425908 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.158+0000 7fbfe2ffd640 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b3091e0 0x55899b30b5d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9eaa93bd26eb1b93 server_cookie=445949877270e460 in_seq=0 out_seq=0 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfc1ffb640 1 -- 172.21.15.103:0/3776163237 <== mds.3 v2:172.21.15.174:6836/604425908 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55899b1a9fa0 con 0x55899b3091e0 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfc1ffb640 10 client.4788 handle_command_reply: tid=0 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 client.4788 shutdown 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241b30 msgr2=0x55899b2f8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241b30 0x55899b2f8770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc007d70 tx=0x7fbfdc0146f0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 shutdown_connections 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:6836/604425908,v1:172.21.15.174:6837/604425908] conn(0x55899b3091e0 0x55899b30b5d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55899b241b30 0x55899b2f8770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfc1ffb640 0 client.4788 ms_handle_reset on v2:172.21.15.174:6836/604425908 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55899b241750 0x55899b2783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 --2- 172.21.15.103:0/3776163237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55899b23ef80 0x55899b277ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 >> 172.21.15.103:0/3776163237 conn(0x55899b23fe70 msgr2=0x55899b271150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 shutdown_connections 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 1 -- 172.21.15.103:0/3776163237 wait complete. 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfec4b7740 20 client.4788 trim_cache size 0 max 16384 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:34.169 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 3, 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4276, 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 16.235208037, 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 18, 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 28, 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 28, 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 56.394362272000002 2024-09-19T05:38:34.170 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbfd006c2b0 msgr2=0x7fbfd006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbfd006c2b0 0x7fbfd006e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4006fd0 tx=0x7fbfd4008040 comp rx=0 tx=0).stop 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe415ed80 msgr2=0x7fbfe4153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe415ed80 0x7fbfe4153f80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbfd802a220 tx=0x7fbfd80046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 shutdown_connections 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbfd006c2b0 0x7fbfd006e770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfe406e270 0x7fbfe41544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe415ed80 0x7fbfe4153f80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 --2- 172.21.15.103:0/3150532290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe4154f40 0x7fbfe4158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 >> 172.21.15.103:0/3150532290 conn(0x7fbfe406bc10 msgr2=0x7fbfe40cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.159+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 shutdown_connections 2024-09-19T05:38:34.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.160+0000 7fbfe9728640 1 -- 172.21.15.103:0/3150532290 wait complete. 2024-09-19T05:38:34.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T05:38:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.270+0000 7f72de653640 1 Processor -- start 2024-09-19T05:38:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.270+0000 7f72de653640 1 -- start start 2024-09-19T05:38:34.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72de653640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d8151d80 0x7f72d80c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72de653640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f72d80c9a90 0x7f72d8158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72de653640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72d815ba80 0x7f72d806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72de653640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f72d815bf30 con 0x7f72d80c9a90 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72de653640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f72d806d940 con 0x7f72d815ba80 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72de653640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f72d80c8040 con 0x7f72d8151d80 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f72d80c9a90 0x7f72d8158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f72d80c9a90 0x7f72d8158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56980/0 (socket says 172.21.15.103:56980) 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 -- 172.21.15.103:0/345809775 learned_addr learned my addr 172.21.15.103:0/345809775 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/345809775 >> v2:172.21.15.174:3300/0 conn(0x7f72d815ba80 0x7f72d806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d7fff640 1 --2- 172.21.15.103:0/345809775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d8151d80 0x7f72d80c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 -- 172.21.15.103:0/345809775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d8151d80 msgr2=0x7f72d80c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 --2- 172.21.15.103:0/345809775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d8151d80 0x7f72d80c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 -- 172.21.15.103:0/345809775 >> v2:172.21.15.174:3300/0 conn(0x7f72d815ba80 msgr2=0x7f72d806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 --2- 172.21.15.103:0/345809775 >> v2:172.21.15.174:3300/0 conn(0x7f72d815ba80 0x7f72d806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72d77fe640 1 -- 172.21.15.103:0/345809775 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d806dc00 con 0x7f72d80c9a90 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.271+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/345809775 >> v2:172.21.15.174:3300/0 conn(0x7f72d815ba80 0x7f72d806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.272+0000 7f72d77fe640 1 --2- 172.21.15.103:0/345809775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d80c9a90 0x7f72d8158f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72d806d8b0 tx=0x7f72cc02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d39c78183e0152 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.272+0000 7f72d6ffd640 1 -- 172.21.15.103:0/345809775 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc032790 con 0x7f72d80c9a90 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.272+0000 7f72d6ffd640 1 -- 172.21.15.103:0/345809775 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc038070 con 0x7f72d80c9a90 2024-09-19T05:38:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.272+0000 7f72d6ffd640 1 -- 172.21.15.103:0/345809775 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc032b50 con 0x7f72d80c9a90 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 -- 172.21.15.103:0/345809775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d80c9a90 msgr2=0x7f72d8158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 --2- 172.21.15.103:0/345809775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d80c9a90 0x7f72d8158f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72d806d8b0 tx=0x7f72cc02c890 comp rx=0 tx=0).stop 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 -- 172.21.15.103:0/345809775 shutdown_connections 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 --2- 172.21.15.103:0/345809775 >> v2:172.21.15.174:3300/0 conn(0x7f72d815ba80 0x7f72d806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 --2- 172.21.15.103:0/345809775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d80c9a90 0x7f72d8158f70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 --2- 172.21.15.103:0/345809775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d8151d80 0x7f72d80c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 -- 172.21.15.103:0/345809775 >> 172.21.15.103:0/345809775 conn(0x7f72d80ca140 msgr2=0x7f72d80ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 -- 172.21.15.103:0/345809775 shutdown_connections 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.273+0000 7f72de653640 1 -- 172.21.15.103:0/345809775 wait complete. 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.274+0000 7f72de653640 1 Processor -- start 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.274+0000 7f72de653640 1 -- start start 2024-09-19T05:38:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72de653640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72d80c9a90 0x7f72d8073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72de653640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d8151d80 0x7f72d80cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72de653640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d815ba80 0x7f72d80cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72de653640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80c85e0 con 0x7f72d8151d80 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72de653640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80c8300 con 0x7f72d80c9a90 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72de653640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f72d80c88c0 con 0x7f72d815ba80 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d8151d80 0x7f72d80cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d8151d80 0x7f72d80cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56988/0 (socket says 172.21.15.103:56988) 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 -- 172.21.15.103:0/4082395890 learned_addr learned my addr 172.21.15.103:0/4082395890 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d815ba80 0x7f72d80cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d7fff640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72d80c9a90 0x7f72d8073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 -- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d815ba80 msgr2=0x7f72d80cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d815ba80 0x7f72d80cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 -- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72d80c9a90 msgr2=0x7f72d8073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72d80c9a90 0x7f72d8073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 -- 172.21.15.103:0/4082395890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d8072500 con 0x7f72d8151d80 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d815ba80 0x7f72d80cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d7fff640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72d80c9a90 0x7f72d8073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d77fe640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d8151d80 0x7f72d80cc3e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b2c0 tx=0x7f72cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d4ff9640 1 -- 172.21.15.103:0/4082395890 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc033830 con 0x7f72d8151d80 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d4ff9640 1 -- 172.21.15.103:0/4082395890 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc0339f0 con 0x7f72d8151d80 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d80727a0 con 0x7f72d8151d80 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.275+0000 7f72d4ff9640 1 -- 172.21.15.103:0/4082395890 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc033de0 con 0x7f72d8151d80 2024-09-19T05:38:34.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.276+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d8072d60 con 0x7f72d8151d80 2024-09-19T05:38:34.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.277+0000 7f72d4ff9640 1 -- 172.21.15.103:0/4082395890 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72cc0463f0 con 0x7f72d8151d80 2024-09-19T05:38:34.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.277+0000 7f72d4ff9640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f72c406c2e0 0x7f72c406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.277+0000 7f72d4ff9640 1 -- 172.21.15.103:0/4082395890 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f72cc0ae9a0 con 0x7f72d8151d80 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.277+0000 7f72d7fff640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f72c406c2e0 0x7f72c406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.278+0000 7f72d7fff640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f72c406c2e0 0x7f72c406e7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006fd0 tx=0x7f72c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.278+0000 7f72e13ec740 1 Processor -- start 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.278+0000 7f72e13ec740 1 -- start start 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49750 0x55734bd819e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd81f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49b30 0x55734bd45a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72e13ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55734bcaa520 con 0x55734bd49b30 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55734bc523e0 con 0x55734bd46f80 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55734bca64e0 con 0x55734bd49750 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72dcbf0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49b30 0x55734bd45a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72dcbf0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49b30 0x55734bd45a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56990/0 (socket says 172.21.15.103:56990) 2024-09-19T05:38:34.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72dcbf0640 1 -- 172.21.15.103:0/1476801790 learned_addr learned my addr 172.21.15.103:0/1476801790 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72d77fe640 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd81f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72d7fff640 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49750 0x55734bd819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72dcbf0640 1 -- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49750 msgr2=0x55734bd819e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49750 0x55734bd819e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72dcbf0640 1 -- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 msgr2=0x55734bd81f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.279+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd81f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72dcbf0640 1 -- 172.21.15.103:0/1476801790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734bc6d2f0 con 0x55734bd49b30 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49b30 0x55734bd45a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009bf0 tx=0x7f72d0004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c7a8642ae38b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72bdffb640 1 -- 172.21.15.103:0/1476801790 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0013780 con 0x55734bd49b30 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72bdffb640 1 -- 172.21.15.103:0/1476801790 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0019070 con 0x55734bd49b30 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72bdffb640 1 -- 172.21.15.103:0/1476801790 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0013b20 con 0x55734bd49b30 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 -- 172.21.15.103:0/1476801790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49b30 msgr2=0x55734bd45a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49b30 0x55734bd45a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009bf0 tx=0x7f72d0004410 comp rx=0 tx=0).stop 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 -- 172.21.15.103:0/1476801790 shutdown_connections 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49b30 0x55734bd45a60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd81f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 --2- 172.21.15.103:0/1476801790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49750 0x55734bd819e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 -- 172.21.15.103:0/1476801790 >> 172.21.15.103:0/1476801790 conn(0x55734bd47e70 msgr2=0x55734bd48270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 -- 172.21.15.103:0/1476801790 shutdown_connections 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.280+0000 7f72e13ec740 1 -- 172.21.15.103:0/1476801790 wait complete. 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.281+0000 7f72e13ec740 1 -- start start 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.281+0000 7f72e13ec740 1 Processor -- start 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd45f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734bd6ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 0x55734bd76600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72e13ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55734bd48fe0 con 0x55734bd49750 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55734bc33450 con 0x55734bd46f80 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55734bd81550 con 0x55734bd49b30 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72e13ec740 10 client.0 _ll_register_callbacks cb 0x55734b9bcac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734bd6ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd45f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734bd6ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57006/0 (socket says 172.21.15.103:57006) 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 -- 172.21.15.103:0/631966410 learned_addr learned my addr 172.21.15.103:0/631966410 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 0x55734bd76600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 -- 172.21.15.103:0/631966410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 msgr2=0x55734bd76600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 0x55734bd76600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 -- 172.21.15.103:0/631966410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 msgr2=0x55734bd45f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd45f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 -- 172.21.15.103:0/631966410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55734b9bd2d0 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72d77fe640 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734bd6ea30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f72cc02c8d0 tx=0x7f72cc07cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d76f9b6062d028b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.282+0000 7f72b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72b6ffd640 1 -- 172.21.15.103:0/631966410 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc085310 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72b6ffd640 1 -- 172.21.15.103:0/631966410 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f72cc084e80 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72d0019070 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72b6ffd640 1 -- 172.21.15.103:0/631966410 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f72cc032e80 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 10 client.4800 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55734ba876b0 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72b6ffd640 1 -- 172.21.15.103:0/631966410 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0019070 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72b6ffd640 1 -- 172.21.15.103:0/631966410 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f72cc00e040 con 0x55734bd49750 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 10 client.4800 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 10 client.4800 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 20 client.4800 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd7b630 0x55734bda7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 4 client.4800 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 --> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55734bcb7c50 con 0x55734bd7b630 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.283+0000 7f72d7fff640 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd7b630 0x55734bda7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72d7fff640 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd7b630 0x55734bda7790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a2c960fe1affa50 server_cookie=535a442148f63248 in_seq=0 out_seq=0 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72b6ffd640 10 client.4800 ms_handle_connect on v2:172.21.15.103:6834/2341226700 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72b6ffd640 1 -- 172.21.15.103:0/631966410 <== mds.2 v2:172.21.15.103:6834/2341226700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55734bcb7c50 con 0x55734bd7b630 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72b6ffd640 10 client.4800 handle_command_reply: tid=0 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 client.4800 shutdown 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 msgr2=0x55734bd6ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734bd6ea30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f72cc02c8d0 tx=0x7f72cc07cef0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 shutdown_connections 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 0x55734bd76600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734bd6ea30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd7b630 0x55734bda7790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 --2- 172.21.15.103:0/631966410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd46f80 0x55734bd45f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72b6ffd640 0 client.4800 ms_handle_reset on v2:172.21.15.103:6834/2341226700 2024-09-19T05:38:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.284+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 >> 172.21.15.103:0/631966410 conn(0x55734bd47e70 msgr2=0x55734bd8ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.285+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 shutdown_connections 2024-09-19T05:38:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.285+0000 7f72e13ec740 1 -- 172.21.15.103:0/631966410 wait complete. 2024-09-19T05:38:34.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.285+0000 7f72e13ec740 20 client.4800 trim_cache size 0 max 16384 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.302+0000 7f72e13ec740 1 Processor -- start 2024-09-19T05:38:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.302+0000 7f72e13ec740 1 -- start start 2024-09-19T05:38:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd46f80 0x55734bd45b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49750 0x55734bd48250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 0x55734bd48790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72e13ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f72d81ed3e0 con 0x55734bd46f80 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55734bc33450 con 0x55734bd49750 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55734bd48fe0 con 0x55734bd49b30 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd46f80 0x55734bd45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd46f80 0x55734bd45b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57014/0 (socket says 172.21.15.103:57014) 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 -- 172.21.15.103:0/2193910704 learned_addr learned my addr 172.21.15.103:0/2193910704 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 -- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 msgr2=0x55734bd48790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 0x55734bd48790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d77fe640 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49750 0x55734bd48250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 -- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49750 msgr2=0x55734bd48250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49750 0x55734bd48250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d7fff640 1 -- 172.21.15.103:0/2193910704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734bd45580 con 0x55734bd46f80 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.303+0000 7f72d77fe640 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49750 0x55734bd48250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72d7fff640 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd46f80 0x55734bd45b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72c800f910 tx=0x7f72c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8107b3643fd286 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72bd7fa640 1 -- 172.21.15.103:0/2193910704 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c802f070 con 0x55734bd46f80 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72bd7fa640 1 -- 172.21.15.103:0/2193910704 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c801c040 con 0x55734bd46f80 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72bd7fa640 1 -- 172.21.15.103:0/2193910704 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c801b050 con 0x55734bd46f80 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 -- 172.21.15.103:0/2193910704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd46f80 msgr2=0x55734bd45b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd46f80 0x55734bd45b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72c800f910 tx=0x7f72c8015000 comp rx=0 tx=0).stop 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 -- 172.21.15.103:0/2193910704 shutdown_connections 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd49b30 0x55734bd48790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49750 0x55734bd48250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2193910704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd46f80 0x55734bd45b80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 -- 172.21.15.103:0/2193910704 >> 172.21.15.103:0/2193910704 conn(0x55734bd47e70 msgr2=0x55734bd3e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 -- 172.21.15.103:0/2193910704 shutdown_connections 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.304+0000 7f72e13ec740 1 -- 172.21.15.103:0/2193910704 wait complete. 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.305+0000 7f72e13ec740 1 -- start start 2024-09-19T05:38:34.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.305+0000 7f72e13ec740 1 Processor -- start 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd46f80 0x55734bd48440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734be06f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72e13ec740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49b30 0x55734be00d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72e13ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55734bd71790 con 0x55734bd49750 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55734bd9cf10 con 0x55734bd49b30 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72e13ec740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55734bd7c5a0 con 0x55734bd46f80 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72e13ec740 10 client.0 _ll_register_callbacks cb 0x7f72cc006cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734be06f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734be06f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57020/0 (socket says 172.21.15.103:57020) 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 -- 172.21.15.103:0/2511904441 learned_addr learned my addr 172.21.15.103:0/2511904441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72dcbf0640 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49b30 0x55734be00d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d7fff640 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd46f80 0x55734bd48440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 -- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd46f80 msgr2=0x55734bd48440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd46f80 0x55734bd48440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 -- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49b30 msgr2=0x55734be00d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49b30 0x55734be00d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 -- 172.21.15.103:0/2511904441 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55734bd3e5a0 con 0x55734bd49750 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72d77fe640 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734be06f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72cc07c090 tx=0x7f72cc083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4637cc02d9895a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.306+0000 7f72b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72b6ffd640 1 -- 172.21.15.103:0/2511904441 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc085310 con 0x55734bd49750 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72b6ffd640 1 -- 172.21.15.103:0/2511904441 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f72cc090bc0 con 0x55734bd49750 2024-09-19T05:38:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c801c040 con 0x55734bd49750 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72b6ffd640 1 -- 172.21.15.103:0/2511904441 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f72cc0850d0 con 0x55734bd49750 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 10 client.4806 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55734bd7d100 con 0x55734bd49750 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72b6ffd640 1 -- 172.21.15.103:0/2511904441 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c801c040 con 0x55734bd49750 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72b6ffd640 1 -- 172.21.15.103:0/2511904441 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f72cc07bb80 con 0x55734bd49750 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 10 client.4806 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 10 client.4806 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 20 client.4806 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd79610 0x55734bd799f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 4 client.4806 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 --> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] -- command(tid 0: {"prefix": "status"}) -- 0x55734bcb1fa0 con 0x55734bd79610 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72d7fff640 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd79610 0x55734bd799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72b6ffd640 10 client.4806 ms_handle_connect on v2:172.21.15.103:6834/2341226700 2024-09-19T05:38:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.307+0000 7f72d7fff640 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd79610 0x55734bd799f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb72c0eb87e7a7c0 server_cookie=91a76ac9c60c9d57 in_seq=0 out_seq=0 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72b6ffd640 1 -- 172.21.15.103:0/2511904441 <== mds.2 v2:172.21.15.103:6834/2341226700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55734bcb1fa0 con 0x55734bd79610 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72b6ffd640 10 client.4806 handle_command_reply: tid=0 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 client.4806 shutdown 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 msgr2=0x55734be06f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734be06f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72cc07c090 tx=0x7f72cc083040 comp rx=0 tx=0).stop 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 shutdown_connections 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:6834/2341226700,v1:172.21.15.103:6836/2341226700] conn(0x55734bd79610 0x55734bd799f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55734bd49b30 0x55734be00d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72b6ffd640 0 client.4806 ms_handle_reset on v2:172.21.15.103:6834/2341226700 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55734bd49750 0x55734be06f20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 --2- 172.21.15.103:0/2511904441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55734bd46f80 0x55734bd48440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 >> 172.21.15.103:0/2511904441 conn(0x55734bd47e70 msgr2=0x55734bd6da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 shutdown_connections 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 1 -- 172.21.15.103:0/2511904441 wait complete. 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72e13ec740 20 client.4806 trim_cache size 0 max 16384 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4296, 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T05:38:34.317 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 22.403460042999999, 2024-09-19T05:38:34.318 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 18, 2024-09-19T05:38:34.318 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 28, 2024-09-19T05:38:34.318 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 28, 2024-09-19T05:38:34.318 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 56.564423423999997 2024-09-19T05:38:34.318 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f72c406c2e0 msgr2=0x7f72c406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f72c406c2e0 0x7f72c406e7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72c8006fd0 tx=0x7f72c8008040 comp rx=0 tx=0).stop 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d8151d80 msgr2=0x7f72d80cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d8151d80 0x7f72d80cc3e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b2c0 tx=0x7f72cc0046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 shutdown_connections 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f72c406c2e0 0x7f72c406e7a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d815ba80 0x7f72d80cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.308+0000 7f72de653640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72d8151d80 0x7f72d80cc3e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.309+0000 7f72de653640 1 --2- 172.21.15.103:0/4082395890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72d80c9a90 0x7f72d8073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.309+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 >> 172.21.15.103:0/4082395890 conn(0x7f72d80ca140 msgr2=0x7f72d815a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.309+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 shutdown_connections 2024-09-19T05:38:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.309+0000 7f72de653640 1 -- 172.21.15.103:0/4082395890 wait complete. 2024-09-19T05:38:34.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T05:38:34.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.419+0000 7f710d065640 1 Processor -- start 2024-09-19T05:38:34.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.419+0000 7f710d065640 1 -- start start 2024-09-19T05:38:34.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710d065640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f7108073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710d065640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7108155490 0x7f71080ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710d065640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71080c9d00 con 0x7f710806d730 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710d065640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f710815edb0 con 0x7f7108155490 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710d065640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f71080ca9b0 con 0x7f71081550b0 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710759e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7108155490 0x7f71080ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710759e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7108155490 0x7f71080ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57032/0 (socket says 172.21.15.103:57032) 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710759e640 1 -- 172.21.15.103:0/1165557807 learned_addr learned my addr 172.21.15.103:0/1165557807 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f7106d9d640 1 --2- 172.21.15.103:0/1165557807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f7108073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710759e640 1 -- 172.21.15.103:0/1165557807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 msgr2=0x7f7108073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710759e640 1 --2- 172.21.15.103:0/1165557807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f7108073f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710759e640 1 -- 172.21.15.103:0/1165557807 >> v1:172.21.15.174:6789/0 conn(0x7f710806d730 legacy=0x7f71080ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.420+0000 7f710759e640 1 -- 172.21.15.103:0/1165557807 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710815e4a0 con 0x7f7108155490 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710759e640 1 --2- 172.21.15.103:0/1165557807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080ce6a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7100009e50 tx=0x7f710002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cc954a078bd4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710659c640 1 -- 172.21.15.103:0/1165557807 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100036070 con 0x7f7108155490 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710659c640 1 -- 172.21.15.103:0/1165557807 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100031600 con 0x7f7108155490 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710659c640 1 -- 172.21.15.103:0/1165557807 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71000319d0 con 0x7f7108155490 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 -- 172.21.15.103:0/1165557807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 msgr2=0x7f71080ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 --2- 172.21.15.103:0/1165557807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080ce6a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7100009e50 tx=0x7f710002a7a0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 -- 172.21.15.103:0/1165557807 shutdown_connections 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 --2- 172.21.15.103:0/1165557807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080ce6a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 --2- 172.21.15.103:0/1165557807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f7108073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 -- 172.21.15.103:0/1165557807 >> 172.21.15.103:0/1165557807 conn(0x7f710806c240 msgr2=0x7f7108067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 -- 172.21.15.103:0/1165557807 shutdown_connections 2024-09-19T05:38:34.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.421+0000 7f710d065640 1 -- 172.21.15.103:0/1165557807 wait complete. 2024-09-19T05:38:34.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.423+0000 7f710d065640 1 Processor -- start 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.423+0000 7f710d065640 1 -- start start 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f710815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71080c53a0 0x7f7108149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f710815ea40 con 0x7f7108155490 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f710815e760 con 0x7f71080c53a0 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f710815f240 con 0x7f71081550b0 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57042/0 (socket says 172.21.15.103:57042) 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 -- 172.21.15.103:0/1587244116 learned_addr learned my addr 172.21.15.103:0/1587244116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f7106d9d640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f710815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710759e640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71080c53a0 0x7f7108149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 -- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 msgr2=0x7f710815d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f710815d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 -- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71080c53a0 msgr2=0x7f7108149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71080c53a0 0x7f7108149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 -- 172.21.15.103:0/1587244116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710814eca0 con 0x7f7108155490 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fe59c640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080c41a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c440 tx=0x7f70f000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fffff640 1 -- 172.21.15.103:0/1587244116 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f00052d0 con 0x7f7108155490 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fffff640 1 -- 172.21.15.103:0/1587244116 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f0005470 con 0x7f7108155490 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71080cb670 con 0x7f7108155490 2024-09-19T05:38:34.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f70fffff640 1 -- 172.21.15.103:0/1587244116 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0007260 con 0x7f7108155490 2024-09-19T05:38:34.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.424+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710814c190 con 0x7f7108155490 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.426+0000 7f70fffff640 1 -- 172.21.15.103:0/1587244116 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70f00074c0 con 0x7f7108155490 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.427+0000 7f70fffff640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f70e806c2b0 0x7f70e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.427+0000 7f70fffff640 1 -- 172.21.15.103:0/1587244116 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f70f008ab20 con 0x7f7108155490 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.427+0000 7f7106d9d640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f70e806c2b0 0x7f70e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.427+0000 7f7106d9d640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f70e806c2b0 0x7f70e806e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70f8006fd0 tx=0x7f70f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.428+0000 7f710fe01740 1 Processor -- start 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.428+0000 7f710fe01740 1 -- start start 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.428+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.428+0000 7f710fe01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9ccf80 0x55809fa07f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.428+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cfb30 0x55809f9cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.428+0000 7f710fe01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55809f930520 con 0x55809f9ccf80 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.428+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55809f8d83e0 con 0x55809f9cf750 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55809f92c4e0 con 0x55809f9cfb30 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9ccf80 0x55809fa07f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9ccf80 0x55809fa07f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57044/0 (socket says 172.21.15.103:57044) 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 -- 172.21.15.103:0/3176595927 learned_addr learned my addr 172.21.15.103:0/3176595927 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f7106d9d640 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f710759e640 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cfb30 0x55809f9cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 -- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cfb30 msgr2=0x55809f9cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cfb30 0x55809f9cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 -- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 msgr2=0x55809fa079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa079e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 -- 172.21.15.103:0/3176595927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809f8f32f0 con 0x55809f9ccf80 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fe59c640 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9ccf80 0x55809fa07f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70f0088c50 tx=0x7f70f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9e080a8dce71d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fcd99640 1 -- 172.21.15.103:0/3176595927 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0056970 con 0x55809f9ccf80 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fcd99640 1 -- 172.21.15.103:0/3176595927 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f0056bd0 con 0x55809f9ccf80 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.429+0000 7f70fcd99640 1 -- 172.21.15.103:0/3176595927 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0059b50 con 0x55809f9ccf80 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 -- 172.21.15.103:0/3176595927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9ccf80 msgr2=0x55809fa07f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9ccf80 0x55809fa07f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70f0088c50 tx=0x7f70f0000ed0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 -- 172.21.15.103:0/3176595927 shutdown_connections 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cfb30 0x55809f9cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9ccf80 0x55809fa07f20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 --2- 172.21.15.103:0/3176595927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 -- 172.21.15.103:0/3176595927 >> 172.21.15.103:0/3176595927 conn(0x55809f9cde70 msgr2=0x55809f9ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 -- 172.21.15.103:0/3176595927 shutdown_connections 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 -- 172.21.15.103:0/3176595927 wait complete. 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.430+0000 7f710fe01740 1 -- start start 2024-09-19T05:38:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 1 Processor -- start 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809fa21f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809fa1f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55809f9cefe0 con 0x55809f9cfb30 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55809f8b9450 con 0x55809f9ccf80 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55809fa07550 con 0x55809f9cf750 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710fe01740 10 client.0 _ll_register_callbacks cb 0x55809f642ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57050/0 (socket says 172.21.15.103:57050) 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f710759e640 1 -- 172.21.15.103:0/3420096869 learned_addr learned my addr 172.21.15.103:0/3420096869 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f7106d9d640 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809fa21f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.431+0000 7f70fe59c640 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809fa1f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710759e640 1 -- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 msgr2=0x55809fa1f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710759e640 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809fa1f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710759e640 1 -- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 msgr2=0x55809fa21f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710759e640 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809fa21f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710759e640 1 -- 172.21.15.103:0/3420096869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809f6432d0 con 0x55809f9cfb30 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710759e640 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f31e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7100009e50 tx=0x7f7100004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68691be9f7ac82fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f70e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3420096869 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100036040 con 0x55809f9cfb30 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3420096869 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f71000319d0 con 0x55809f9cfb30 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70f0056bd0 con 0x55809f9cfb30 2024-09-19T05:38:34.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3420096869 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7100051050 con 0x55809f9cfb30 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710fe01740 10 client.4818 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55809f70d6b0 con 0x55809f9cfb30 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3420096869 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f0056bd0 con 0x55809f9cfb30 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3420096869 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f7100054020 con 0x55809f9cfb30 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710fe01740 10 client.4818 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710fe01740 10 client.4818 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710fe01740 20 client.4818 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.432+0000 7f710fe01740 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809f9f26d0 0x55809fa2d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.433+0000 7f710fe01740 4 client.4818 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.433+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 --> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55809f93dc50 con 0x55809f9f26d0 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.433+0000 7f7106d9d640 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809f9f26d0 0x55809fa2d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.433+0000 7f70e5ffb640 10 client.4818 ms_handle_connect on v2:172.21.15.103:6835/2009898073 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.433+0000 7f7106d9d640 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809f9f26d0 0x55809fa2d5c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72890ddf3db91ed6 server_cookie=1cadcae7b911be22 in_seq=0 out_seq=0 2024-09-19T05:38:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3420096869 <== mds.1 v2:172.21.15.103:6835/2009898073 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55809f93dc50 con 0x55809f9f26d0 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f70e5ffb640 10 client.4818 handle_command_reply: tid=0 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 client.4818 shutdown 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 msgr2=0x55809f9f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f31e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7100009e50 tx=0x7f7100004ab0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 shutdown_connections 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809f9f26d0 0x55809fa2d5c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f31e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809fa1f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f70e5ffb640 0 client.4818 ms_handle_reset on v2:172.21.15.103:6835/2009898073 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 --2- 172.21.15.103:0/3420096869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809fa21f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 >> 172.21.15.103:0/3420096869 conn(0x55809f9cde70 msgr2=0x55809fa02a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 shutdown_connections 2024-09-19T05:38:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 1 -- 172.21.15.103:0/3420096869 wait complete. 2024-09-19T05:38:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.434+0000 7f710fe01740 20 client.4818 trim_cache size 0 max 16384 2024-09-19T05:38:34.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 Processor -- start 2024-09-19T05:38:34.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 -- start start 2024-09-19T05:38:34.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809f9cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809f9cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71081f5060 con 0x55809f9cfb30 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55809fa02400 con 0x55809f9ccf80 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55809fa22670 con 0x55809f9cf750 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.452+0000 7f710759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57060/0 (socket says 172.21.15.103:57060) 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 -- 172.21.15.103:0/2277395331 learned_addr learned my addr 172.21.15.103:0/2277395331 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f7106d9d640 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809f9cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f70fe59c640 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809f9cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 -- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 msgr2=0x55809f9cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809f9cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 -- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 msgr2=0x55809f9cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809f9cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 -- 172.21.15.103:0/2277395331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809f9cb580 con 0x55809f9cfb30 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f7106d9d640 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809f9cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f710759e640 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f2ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71000314c0 tx=0x7f7100040070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304ccb41c2363bec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f70e7fff640 1 -- 172.21.15.103:0/2277395331 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100036070 con 0x55809f9cfb30 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f70e7fff640 1 -- 172.21.15.103:0/2277395331 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100059070 con 0x55809f9cfb30 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.453+0000 7f70e7fff640 1 -- 172.21.15.103:0/2277395331 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71000020c0 con 0x55809f9cfb30 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 -- 172.21.15.103:0/2277395331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 msgr2=0x55809f9f2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f2ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71000314c0 tx=0x7f7100040070 comp rx=0 tx=0).stop 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 -- 172.21.15.103:0/2277395331 shutdown_connections 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809f9f2ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9cf750 0x55809f9cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 --2- 172.21.15.103:0/2277395331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9ccf80 0x55809f9cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 -- 172.21.15.103:0/2277395331 >> 172.21.15.103:0/2277395331 conn(0x55809f9cde70 msgr2=0x55809fa18b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 -- 172.21.15.103:0/2277395331 shutdown_connections 2024-09-19T05:38:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 -- 172.21.15.103:0/2277395331 wait complete. 2024-09-19T05:38:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 -- start start 2024-09-19T05:38:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.454+0000 7f710fe01740 1 Processor -- start 2024-09-19T05:38:34.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9ccf80 0x55809f9f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710fe01740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa87150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710fe01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809fa87690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710fe01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55809f9f2550 con 0x55809f9cfb30 2024-09-19T05:38:34.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55809f9f37c0 con 0x55809f9cf750 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710fe01740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55809f9ff380 con 0x55809f9ccf80 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710fe01740 10 client.0 _ll_register_callbacks cb 0x7f7100009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809fa87690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809fa87690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57068/0 (socket says 172.21.15.103:57068) 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 -- 172.21.15.103:0/3294370482 learned_addr learned my addr 172.21.15.103:0/3294370482 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f70fe59c640 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa87150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f7106d9d640 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9ccf80 0x55809f9f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 -- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9ccf80 msgr2=0x55809f9f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9ccf80 0x55809f9f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 -- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 msgr2=0x55809fa87150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa87150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.455+0000 7f710759e640 1 -- 172.21.15.103:0/3294370482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809f9cdbe0 con 0x55809f9cfb30 2024-09-19T05:38:34.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710759e640 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809fa87690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7100034040 tx=0x7f710002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95100d2f4d6582ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f70e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3294370482 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100036040 con 0x55809f9cfb30 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3294370482 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f71000319d0 con 0x55809f9cfb30 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7100059070 con 0x55809f9cfb30 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3294370482 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f710006b050 con 0x55809f9cfb30 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 10 client.4824 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55809fa07fe0 con 0x55809f9cfb30 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3294370482 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100059070 con 0x55809f9cfb30 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3294370482 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f710006e020 con 0x55809f9cfb30 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 10 client.4824 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 10 client.4824 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 20 client.4824 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809fa06350 0x55809fa99b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 4 client.4824 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 --> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] -- command(tid 0: {"prefix": "status"}) -- 0x55809f937fa0 con 0x55809fa06350 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.456+0000 7f7106d9d640 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809fa06350 0x55809fa99b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f70e5ffb640 10 client.4824 ms_handle_connect on v2:172.21.15.103:6835/2009898073 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f7106d9d640 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809fa06350 0x55809fa99b50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee99c1912682edcb server_cookie=25843473ff0f2f50 in_seq=0 out_seq=0 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f70e5ffb640 1 -- 172.21.15.103:0/3294370482 <== mds.1 v2:172.21.15.103:6835/2009898073 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55809f937fa0 con 0x55809fa06350 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f70e5ffb640 10 client.4824 handle_command_reply: tid=0 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 client.4824 shutdown 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 msgr2=0x55809fa87690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809fa87690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7100034040 tx=0x7f710002f000 comp rx=0 tx=0).stop 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 shutdown_connections 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:6835/2009898073,v1:172.21.15.103:6837/2009898073] conn(0x55809fa06350 0x55809fa99b50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55809f9cfb30 0x55809fa87690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55809f9cf750 0x55809fa87150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 --2- 172.21.15.103:0/3294370482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55809f9ccf80 0x55809f9f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f70e5ffb640 0 client.4824 ms_handle_reset on v2:172.21.15.103:6835/2009898073 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 >> 172.21.15.103:0/3294370482 conn(0x55809f9cde70 msgr2=0x55809fa18b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 shutdown_connections 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 1 -- 172.21.15.103:0/3294370482 wait complete. 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.457+0000 7f710fe01740 20 client.4824 trim_cache size 0 max 16384 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-19T05:38:34.466 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4299, 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 28.584767244999998, 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 18, 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 28, 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 28, 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 56.713430885999998 2024-09-19T05:38:34.467 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f70e806c2b0 msgr2=0x7f70e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f70e806c2b0 0x7f70e806e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70f8006fd0 tx=0x7f70f8008040 comp rx=0 tx=0).stop 2024-09-19T05:38:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 msgr2=0x7f71080c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080c41a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c440 tx=0x7f70f000c900 comp rx=0 tx=0).stop 2024-09-19T05:38:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 shutdown_connections 2024-09-19T05:38:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f70e806c2b0 0x7f70e806e770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71080c53a0 0x7f7108149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7108155490 0x7f71080c41a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 --2- 172.21.15.103:0/1587244116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71081550b0 0x7f710815d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 >> 172.21.15.103:0/1587244116 conn(0x7f710806c240 msgr2=0x7f710814fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 shutdown_connections 2024-09-19T05:38:34.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.458+0000 7f710d065640 1 -- 172.21.15.103:0/1587244116 wait complete. 2024-09-19T05:38:34.471 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-19T05:38:34.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.567+0000 7f713f8c9640 1 Processor -- start 2024-09-19T05:38:34.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.567+0000 7f713f8c9640 1 -- start start 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713f8c9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138152d40 0x7f71380c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713f8c9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7138070cf0 0x7f71380c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713f8c9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71380c6850 con 0x7f7138153120 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713f8c9640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7138158e00 con 0x7f7138070cf0 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713f8c9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f71381590e0 con 0x7f7138152d40 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713ce64640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7138070cf0 0x7f71380c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713ce64640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7138070cf0 0x7f71380c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57080/0 (socket says 172.21.15.103:57080) 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713ce64640 1 -- 172.21.15.103:0/3128249704 learned_addr learned my addr 172.21.15.103:0/3128249704 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713d665640 1 --2- 172.21.15.103:0/3128249704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138152d40 0x7f71380c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713ce64640 1 -- 172.21.15.103:0/3128249704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138152d40 msgr2=0x7f71380c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713ce64640 1 --2- 172.21.15.103:0/3128249704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138152d40 0x7f71380c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713ce64640 1 -- 172.21.15.103:0/3128249704 >> v1:172.21.15.174:6789/0 conn(0x7f7138153120 legacy=0x7f713815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.568+0000 7f713ce64640 1 -- 172.21.15.103:0/3128249704 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71381593c0 con 0x7f7138070cf0 2024-09-19T05:38:34.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.569+0000 7f713ce64640 1 --2- 172.21.15.103:0/3128249704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71380c6290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7128009870 tx=0x7f712802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a01e12efac88e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.569+0000 7f712ffff640 1 -- 172.21.15.103:0/3128249704 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128037070 con 0x7f7138070cf0 2024-09-19T05:38:34.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.569+0000 7f712ffff640 1 -- 172.21.15.103:0/3128249704 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7128032440 con 0x7f7138070cf0 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.569+0000 7f712ffff640 1 -- 172.21.15.103:0/3128249704 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128032810 con 0x7f7138070cf0 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 -- 172.21.15.103:0/3128249704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 msgr2=0x7f71380c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3128249704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71380c6290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7128009870 tx=0x7f712802a2a0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 -- 172.21.15.103:0/3128249704 shutdown_connections 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3128249704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71380c6290 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3128249704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138152d40 0x7f71380c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 -- 172.21.15.103:0/3128249704 >> 172.21.15.103:0/3128249704 conn(0x7f7138067890 msgr2=0x7f7138067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 -- 172.21.15.103:0/3128249704 shutdown_connections 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.570+0000 7f713f8c9640 1 -- 172.21.15.103:0/3128249704 wait complete. 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.571+0000 7f713f8c9640 1 Processor -- start 2024-09-19T05:38:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.571+0000 7f713f8c9640 1 -- start start 2024-09-19T05:38:34.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713f8c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71381584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713f8c9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7138152d40 0x7f713814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713f8c9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138153120 0x7f713814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713f8c9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f713815c9b0 con 0x7f7138070cf0 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713f8c9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7138159980 con 0x7f7138152d40 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713f8c9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f713815cb30 con 0x7f7138153120 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71381584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71381584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57096/0 (socket says 172.21.15.103:57096) 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 -- 172.21.15.103:0/3167572828 learned_addr learned my addr 172.21.15.103:0/3167572828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713ce64640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7138152d40 0x7f713814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713de66640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138153120 0x7f713814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 -- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138153120 msgr2=0x7f713814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138153120 0x7f713814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 -- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7138152d40 msgr2=0x7f713814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7138152d40 0x7f713814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 -- 172.21.15.103:0/3167572828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71380c6310 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713d665640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71381584d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f713400c7f0 tx=0x7f713400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f712dffb640 1 -- 172.21.15.103:0/3167572828 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134015070 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f712dffb640 1 -- 172.21.15.103:0/3167572828 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7134004240 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f712dffb640 1 -- 172.21.15.103:0/3167572828 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134007620 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.572+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713815ba00 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.573+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713815bca0 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.574+0000 7f712dffb640 1 -- 172.21.15.103:0/3167572828 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f71340079d0 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.574+0000 7f712dffb640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f711c06c2e0 0x7f711c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.574+0000 7f712dffb640 1 -- 172.21.15.103:0/3167572828 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f713408b840 con 0x7f7138070cf0 2024-09-19T05:38:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.574+0000 7f713ce64640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f711c06c2e0 0x7f711c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.575+0000 7f713ce64640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f711c06c2e0 0x7f711c06e7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7128034000 tx=0x7f712802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.575+0000 7f7142660740 1 Processor -- start 2024-09-19T05:38:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.575+0000 7f7142660740 1 -- start start 2024-09-19T05:38:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f7142660740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316750 0x55cb4b34e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b34ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316b30 0x55cb4b312a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f7142660740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cb4b277520 con 0x55cb4b316750 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb4b21f3e0 con 0x55cb4b313f80 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55cb4b2734e0 con 0x55cb4b316b30 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316750 0x55cb4b34e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316750 0x55cb4b34e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57104/0 (socket says 172.21.15.103:57104) 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 -- 172.21.15.103:0/2159363204 learned_addr learned my addr 172.21.15.103:0/2159363204 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713de66640 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316b30 0x55cb4b312a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713ce64640 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b34ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 -- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316b30 msgr2=0x55cb4b312a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316b30 0x55cb4b312a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 -- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 msgr2=0x55cb4b34ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b34ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 -- 172.21.15.103:0/2159363204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb4b23a2f0 con 0x55cb4b316750 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.576+0000 7f713d665640 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316750 0x55cb4b34e9e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7134006fd0 tx=0x7f7134059680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b7df7ff28888c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f711affd640 1 -- 172.21.15.103:0/2159363204 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713401e040 con 0x55cb4b316750 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f711affd640 1 -- 172.21.15.103:0/2159363204 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7134057840 con 0x55cb4b316750 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f711affd640 1 -- 172.21.15.103:0/2159363204 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134007cc0 con 0x55cb4b316750 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 -- 172.21.15.103:0/2159363204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316750 msgr2=0x55cb4b34e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316750 0x55cb4b34e9e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7134006fd0 tx=0x7f7134059680 comp rx=0 tx=0).stop 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 -- 172.21.15.103:0/2159363204 shutdown_connections 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316b30 0x55cb4b312a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b34ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 --2- 172.21.15.103:0/2159363204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316750 0x55cb4b34e9e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 -- 172.21.15.103:0/2159363204 >> 172.21.15.103:0/2159363204 conn(0x55cb4b314e70 msgr2=0x55cb4b315270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 -- 172.21.15.103:0/2159363204 shutdown_connections 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.577+0000 7f7142660740 1 -- 172.21.15.103:0/2159363204 wait complete. 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.578+0000 7f7142660740 1 -- start start 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.578+0000 7f7142660740 1 Processor -- start 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b33b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 0x55cb4b336d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cb4b315fe0 con 0x55cb4b313f80 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb4b200450 con 0x55cb4b316b30 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55cb4b34e550 con 0x55cb4b316750 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 10 client.0 _ll_register_callbacks cb 0x55cb4af89ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b33b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b33b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57108/0 (socket says 172.21.15.103:57108) 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 -- 172.21.15.103:0/2063489840 learned_addr learned my addr 172.21.15.103:0/2063489840 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713de66640 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 0x55cb4b336d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713ce64640 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 -- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 msgr2=0x55cb4b34ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 -- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 msgr2=0x55cb4b336d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 0x55cb4b336d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 -- 172.21.15.103:0/2063489840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb4af8a2d0 con 0x55cb4b313f80 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f713d665640 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b33b400 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f71340899d0 tx=0x7f7134000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1457a8213c6014b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7113fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7113fff640 1 -- 172.21.15.103:0/2063489840 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713401e040 con 0x55cb4b313f80 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7113fff640 1 -- 172.21.15.103:0/2063489840 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f7134058b90 con 0x55cb4b313f80 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.579+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7134057840 con 0x55cb4b313f80 2024-09-19T05:38:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7113fff640 1 -- 172.21.15.103:0/2063489840 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f71340557e0 con 0x55cb4b313f80 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 10 client.4836 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55cb4b0546b0 con 0x55cb4b313f80 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7113fff640 1 -- 172.21.15.103:0/2063489840 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7134057840 con 0x55cb4b313f80 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7113fff640 1 -- 172.21.15.103:0/2063489840 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f7134055290 con 0x55cb4b313f80 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 10 client.4836 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 10 client.4836 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 20 client.4836 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b371c80 0x55cb4b374070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 4 client.4836 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 --> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb4b284c50 con 0x55cb4b371c80 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f713ce64640 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b371c80 0x55cb4b374070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f7113fff640 10 client.4836 ms_handle_connect on v2:172.21.15.103:6838/2567820767 2024-09-19T05:38:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.580+0000 7f713ce64640 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b371c80 0x55cb4b374070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c963916eaa36f481 server_cookie=da2f254cb1ba9f8d in_seq=0 out_seq=0 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7113fff640 1 -- 172.21.15.103:0/2063489840 <== mds.0 v2:172.21.15.103:6838/2567820767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb4b284c50 con 0x55cb4b371c80 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7113fff640 10 client.4836 handle_command_reply: tid=0 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 client.4836 shutdown 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 msgr2=0x55cb4b33b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b33b400 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f71340899d0 tx=0x7f7134000bc0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 shutdown_connections 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b371c80 0x55cb4b374070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 0x55cb4b336d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7113fff640 0 client.4836 ms_handle_reset on v2:172.21.15.103:6838/2567820767 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 --2- 172.21.15.103:0/2063489840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b33b400 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 >> 172.21.15.103:0/2063489840 conn(0x55cb4b314e70 msgr2=0x55cb4b30f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 shutdown_connections 2024-09-19T05:38:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 1 -- 172.21.15.103:0/2063489840 wait complete. 2024-09-19T05:38:34.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.581+0000 7f7142660740 20 client.4836 trim_cache size 0 max 16384 2024-09-19T05:38:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.599+0000 7f7142660740 1 Processor -- start 2024-09-19T05:38:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.599+0000 7f7142660740 1 -- start start 2024-09-19T05:38:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f7142660740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b315990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b368ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 0x55cb4b369410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f7142660740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71381fad30 con 0x55cb4b313f80 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb4b200450 con 0x55cb4b316b30 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55cb4b315fe0 con 0x55cb4b316750 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b315990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b315990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57122/0 (socket says 172.21.15.103:57122) 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 -- 172.21.15.103:0/1762875893 learned_addr learned my addr 172.21.15.103:0/1762875893 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 -- 172.21.15.103:0/1762875893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 msgr2=0x55cb4b368ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 --2- 172.21.15.103:0/1762875893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b368ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 -- 172.21.15.103:0/1762875893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 msgr2=0x55cb4b369410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 --2- 172.21.15.103:0/1762875893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 0x55cb4b369410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 -- 172.21.15.103:0/1762875893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb4b349600 con 0x55cb4b313f80 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f713d665640 1 --2- 172.21.15.103:0/1762875893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b315990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7134089a50 tx=0x7f713406f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41b4f176960572b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f711a7fc640 1 -- 172.21.15.103:0/1762875893 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713401e020 con 0x55cb4b313f80 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f711a7fc640 1 -- 172.21.15.103:0/1762875893 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7134057840 con 0x55cb4b313f80 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.600+0000 7f711a7fc640 1 -- 172.21.15.103:0/1762875893 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134058990 con 0x55cb4b313f80 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 -- 172.21.15.103:0/1762875893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 msgr2=0x55cb4b315990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 --2- 172.21.15.103:0/1762875893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b315990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7134089a50 tx=0x7f713406f070 comp rx=0 tx=0).stop 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 -- 172.21.15.103:0/1762875893 shutdown_connections 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 --2- 172.21.15.103:0/1762875893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b316b30 0x55cb4b369410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 --2- 172.21.15.103:0/1762875893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b368ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 --2- 172.21.15.103:0/1762875893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b313f80 0x55cb4b315990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 -- 172.21.15.103:0/1762875893 >> 172.21.15.103:0/1762875893 conn(0x55cb4b314e70 msgr2=0x55cb4b34e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 -- 172.21.15.103:0/1762875893 shutdown_connections 2024-09-19T05:38:34.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 -- 172.21.15.103:0/1762875893 wait complete. 2024-09-19T05:38:34.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 -- start start 2024-09-19T05:38:34.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.601+0000 7f7142660740 1 Processor -- start 2024-09-19T05:38:34.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b3d7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f7142660740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f7142660740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316b30 0x55cb4b3d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f7142660740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cb4b34f3b0 con 0x55cb4b316b30 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb4b33bc70 con 0x55cb4b313f80 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f7142660740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55cb4b340ac0 con 0x55cb4b316750 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f7142660740 10 client.0 _ll_register_callbacks cb 0x7f7134070070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f713de66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316b30 0x55cb4b3d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f713de66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316b30 0x55cb4b3d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57126/0 (socket says 172.21.15.103:57126) 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.602+0000 7f713de66640 1 -- 172.21.15.103:0/2785829043 learned_addr learned my addr 172.21.15.103:0/2785829043 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713d665640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b3d7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713ce64640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713de66640 1 -- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 msgr2=0x55cb4b34a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713de66640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713de66640 1 -- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 msgr2=0x55cb4b3d7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713de66640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b3d7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713de66640 1 -- 172.21.15.103:0/2785829043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb4b3d7960 con 0x55cb4b316b30 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713d665640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b3d7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713ce64640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f713de66640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316b30 0x55cb4b3d0ce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f713000bb80 tx=0x7f713000a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26afe3e6b0777f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7113fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7113fff640 1 -- 172.21.15.103:0/2785829043 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130018640 con 0x55cb4b316b30 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7113fff640 1 -- 172.21.15.103:0/2785829043 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f71300187e0 con 0x55cb4b316b30 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7134057840 con 0x55cb4b316b30 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7113fff640 1 -- 172.21.15.103:0/2785829043 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7130025050 con 0x55cb4b316b30 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 10 client.4842 fetch_fsmap learned FSMap version 18 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55cb4b3d7b70 con 0x55cb4b316b30 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7113fff640 1 -- 172.21.15.103:0/2785829043 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7134057840 con 0x55cb4b316b30 2024-09-19T05:38:34.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7113fff640 1 -- 172.21.15.103:0/2785829043 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) ==== 4800+0+0 (secure 0 0 0) 0x7f7130028020 con 0x55cb4b316b30 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 10 client.4842 fetch_fsmap finished waiting for FSMap version 18 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 10 client.4842 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 20 client.4842 populate_metadata read hostname 'smithi103' 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b359320 0x55cb4b3e0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 4 client.4842 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.603+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 --> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] -- command(tid 0: {"prefix": "status"}) -- 0x55cb4b27efa0 con 0x55cb4b359320 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f713d665640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b359320 0x55cb4b3e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7113fff640 10 client.4842 ms_handle_connect on v2:172.21.15.103:6838/2567820767 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f713d665640 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b359320 0x55cb4b3e0480 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c9929db24b2d188 server_cookie=31842c87f2ff2d67 in_seq=0 out_seq=0 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7113fff640 1 -- 172.21.15.103:0/2785829043 <== mds.0 v2:172.21.15.103:6838/2567820767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cb4b27efa0 con 0x55cb4b359320 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7113fff640 10 client.4842 handle_command_reply: tid=0 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 client.4842 shutdown 2024-09-19T05:38:34.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316b30 msgr2=0x55cb4b3d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316b30 0x55cb4b3d0ce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f713000bb80 tx=0x7f713000a7b0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 shutdown_connections 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:6838/2567820767,v1:172.21.15.103:6839/2567820767] conn(0x55cb4b359320 0x55cb4b3e0480 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb4b316b30 0x55cb4b3d0ce0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55cb4b316750 0x55cb4b34a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7113fff640 0 client.4842 ms_handle_reset on v2:172.21.15.103:6838/2567820767 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 --2- 172.21.15.103:0/2785829043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb4b313f80 0x55cb4b3d7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 >> 172.21.15.103:0/2785829043 conn(0x55cb4b314e70 msgr2=0x55cb4b346150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 shutdown_connections 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 1 -- 172.21.15.103:0/2785829043 wait complete. 2024-09-19T05:38:34.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.604+0000 7f7142660740 20 client.4842 trim_cache size 0 max 16384 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4302, 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 50.833507122, 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 18, 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 28, 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 28, 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 56.856734058999997 2024-09-19T05:38:34.614 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:34.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f711c06c2e0 msgr2=0x7f711c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f711c06c2e0 0x7f711c06e7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7128034000 tx=0x7f712802e000 comp rx=0 tx=0).stop 2024-09-19T05:38:34.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 msgr2=0x7f71381584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71381584d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f713400c7f0 tx=0x7f713400ccb0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 shutdown_connections 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f711c06c2e0 0x7f711c06e7a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7138153120 0x7f713814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7138152d40 0x7f713814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 --2- 172.21.15.103:0/3167572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7138070cf0 0x7f71381584d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 >> 172.21.15.103:0/3167572828 conn(0x7f7138067890 msgr2=0x7f713814c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 shutdown_connections 2024-09-19T05:38:34.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.605+0000 7f713f8c9640 1 -- 172.21.15.103:0/3167572828 wait complete. 2024-09-19T05:38:34.618 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T05:38:34.627 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T05:38:34.627 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T05:38:34.628 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T05:38:34.628 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T05:38:34.653 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T05:38:34.654 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T05:38:34.654 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-19T05:38:34.654 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:38:34.654 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:34.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:34.654 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-19T05:38:34.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T05:38:34.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:34.671 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:38:34.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:34.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-19T05:38:34.850 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T05:38:34.850 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T05:38:34.850 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T05:38:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.950+0000 7f8ac391f640 1 Processor -- start 2024-09-19T05:38:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.950+0000 7f8ac391f640 1 -- start start 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac391f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8abc151ea0 0x7f8abc0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac391f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8abc15bc80 con 0x7f8abc0c3a50 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac391f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8abc157c70 con 0x7f8abc0c46c0 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac391f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8abc1585a0 con 0x7f8abc151ea0 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac1ebc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8abc0c3a50 0x7f8abc06eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40810/0 (socket says 172.21.15.103:40810) 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac1ebc640 1 -- 172.21.15.103:0/3341570150 learned_addr learned my addr 172.21.15.103:0/3341570150 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640909700 0 0) 0x7f8abc15bc80 con 0x7f8abc0c3a50 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aa8003520 con 0x7f8abc0c3a50 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac16bb640 1 --2- 172.21.15.103:0/3341570150 >> v2:172.21.15.174:3300/0 conn(0x7f8abc151ea0 0x7f8abc0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 876435352 0 0) 0x7f8aa8003520 con 0x7f8abc0c3a50 2024-09-19T05:38:34.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 >> v2:172.21.15.174:3300/0 conn(0x7f8abc151ea0 msgr2=0x7f8abc0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 --2- 172.21.15.103:0/3341570150 >> v2:172.21.15.174:3300/0 conn(0x7f8abc151ea0 0x7f8abc0c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 >> v1:172.21.15.174:6789/0 conn(0x7f8abc0c46c0 legacy=0x7f8abc158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc157f50 con 0x7f8abc0c3a50 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f8ab8001670 con 0x7f8abc0c3a50 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 >> v1:172.21.15.103:6789/0 conn(0x7f8abc0c3a50 legacy=0x7f8abc06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa80039b0 0x7f8aa8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa8004800 0x7f8aa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8aa80051c0 0x7f8aa800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1585a0 con 0x7f8aa80039b0 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa800c070 con 0x7f8aa8004800 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa800c270 con 0x7f8aa80051c0 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac16bb640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa80039b0 0x7f8aa8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.951+0000 7f8ac0eba640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa8004800 0x7f8aa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac1ebc640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8aa80051c0 0x7f8aa800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac16bb640 1 -- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8aa80051c0 msgr2=0x7f8aa800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac16bb640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8aa80051c0 0x7f8aa800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac16bb640 1 -- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa8004800 msgr2=0x7f8aa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac16bb640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa8004800 0x7f8aa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac16bb640 1 -- 172.21.15.103:0/3341570150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa8003520 con 0x7f8aa80039b0 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac1ebc640 1 -- 172.21.15.103:0/3341570150 reap_dead start 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ac16bb640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa80039b0 0x7f8aa8003dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009fc0 tx=0x7f8aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbf37176877b4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4034020 con 0x7f8aa80039b0 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab40305f0 con 0x7f8aa80039b0 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.952+0000 7f8ab3fff640 1 -- 172.21.15.103:0/3341570150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4009c10 con 0x7f8aa80039b0 2024-09-19T05:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.953+0000 7f8ac391f640 1 -- 172.21.15.103:0/3341570150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa80039b0 msgr2=0x7f8aa8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.953+0000 7f8ac391f640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa80039b0 0x7f8aa8003dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009fc0 tx=0x7f8aa8005830 comp rx=0 tx=0).stop 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.953+0000 7f8ac391f640 1 -- 172.21.15.103:0/3341570150 shutdown_connections 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.953+0000 7f8ac391f640 1 --2- 172.21.15.103:0/3341570150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa80039b0 0x7f8aa8003dd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.953+0000 7f8ac391f640 1 -- 172.21.15.103:0/3341570150 >> 172.21.15.103:0/3341570150 conn(0x7f8abc0c9230 msgr2=0x7f8abc0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.953+0000 7f8ac391f640 1 -- 172.21.15.103:0/3341570150 shutdown_connections 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.953+0000 7f8ac391f640 1 -- 172.21.15.103:0/3341570150 wait complete. 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.954+0000 7f8ac391f640 1 Processor -- start 2024-09-19T05:38:34.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.954+0000 7f8ac391f640 1 -- start start 2024-09-19T05:38:34.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac391f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa80039b0 0x7f8abc1478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac391f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8abc14f6c0 0x7f8abc0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac391f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc147e30 0x7f8abc0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac391f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc158a30 con 0x7f8abc147e30 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac391f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc152280 con 0x7f8aa80039b0 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac391f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8abc15bf20 con 0x7f8abc14f6c0 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc147e30 0x7f8abc0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac16bb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa80039b0 0x7f8abc1478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc147e30 0x7f8abc0cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57140/0 (socket says 172.21.15.103:57140) 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 -- 172.21.15.103:0/584120480 learned_addr learned my addr 172.21.15.103:0/584120480 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac0eba640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8abc14f6c0 0x7f8abc0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 -- 172.21.15.103:0/584120480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8abc14f6c0 msgr2=0x7f8abc0cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8abc14f6c0 0x7f8abc0cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 -- 172.21.15.103:0/584120480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa80039b0 msgr2=0x7f8abc1478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa80039b0 0x7f8abc1478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.955+0000 7f8ac1ebc640 1 -- 172.21.15.103:0/584120480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc1f19e0 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.956+0000 7f8ac1ebc640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc147e30 0x7f8abc0cb8e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0cd5a0 tx=0x7f8ab800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.956+0000 7f8ab1ffb640 1 -- 172.21.15.103:0/584120480 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800c530 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.956+0000 7f8ab1ffb640 1 -- 172.21.15.103:0/584120480 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab8018070 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.956+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc155520 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.956+0000 7f8ab1ffb640 1 -- 172.21.15.103:0/584120480 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800c930 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.956+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8abc1ee580 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.957+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8abc0c89b0 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.957+0000 7f8ab1ffb640 1 -- 172.21.15.103:0/584120480 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ab800cad0 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.958+0000 7f8ab1ffb640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8aa006c2b0 0x7f8aa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.958+0000 7f8ab1ffb640 1 -- 172.21.15.103:0/584120480 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f8ab808b180 con 0x7f8abc147e30 2024-09-19T05:38:34.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.958+0000 7f8ac16bb640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8aa006c2b0 0x7f8aa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:34.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.958+0000 7f8ac16bb640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8aa006c2b0 0x7f8aa006e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4035000 tx=0x7f8ab402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:34.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:34.962+0000 7f8ab1ffb640 1 -- 172.21.15.103:0/584120480 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8ab8058f30 con 0x7f8abc147e30 2024-09-19T05:38:35.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.165+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8abc156350 con 0x7f8abc147e30 2024-09-19T05:38:35.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.165+0000 7f8ab1ffb640 1 -- 172.21.15.103:0/584120480 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+88 (secure 0 0 0) 0x7f8ab805d230 con 0x7f8abc147e30 2024-09-19T05:38:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:38:35.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8aa006c2b0 msgr2=0x7f8aa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:35.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8aa006c2b0 0x7f8aa006e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4035000 tx=0x7f8ab402f000 comp rx=0 tx=0).stop 2024-09-19T05:38:35.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc147e30 msgr2=0x7f8abc0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc147e30 0x7f8abc0cb8e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0cd5a0 tx=0x7f8ab800eb90 comp rx=0 tx=0).stop 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 shutdown_connections 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8aa006c2b0 0x7f8aa006e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc147e30 0x7f8abc0cb8e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8abc14f6c0 0x7f8abc0cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 --2- 172.21.15.103:0/584120480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8aa80039b0 0x7f8abc1478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 >> 172.21.15.103:0/584120480 conn(0x7f8abc0c9230 msgr2=0x7f8abc0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 shutdown_connections 2024-09-19T05:38:35.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35.168+0000 7f8ac391f640 1 -- 172.21.15.103:0/584120480 wait complete. 2024-09-19T05:38:35.181 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:38:35.181 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:38:35.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-19T05:38:35.182 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:38:35.182 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:35.182 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:38:35.182 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:38:35.182 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:38:35.182 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:35.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:35.182 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-19T05:38:35.199 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:38:35.199 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:38:35.199 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:38:35.200 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:35.200 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-19T05:38:35.200 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:35.200 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:38:35.200 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:35.200 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42750sec preferred_lft 42750sec 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-19T05:38:35.201 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:38:35.202 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:38:35.202 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:38:35.202 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:38:35.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:38:35.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-19T05:38:35.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-19T05:38:35.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:38:35.202 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:38:35.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:38:35.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:35.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:35.338 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:38:35.360 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-19T05:38:35.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:35.363 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-19T05:38:35.420 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-19T05:38:35.420 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:38:35.420 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:38:35.420 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:38:35.420 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:38:35.421 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:38:35.421 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:38:35.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:38:35.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:38:35.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:38:35.421 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:38:35.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:38:35.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:35.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:35.547 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-19T05:38:35.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:35.563 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-19T05:38:35.617 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:38:35.618 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:38:35.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:35.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T05:38:35.618 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:38:35.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:38:35.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:35.734 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T05:38:35.734 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:38:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:38:35.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:35.848 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:38:35.848 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-19T05:38:35.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-19T05:38:35.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:38:35.848 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-19T05:38:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:38:35.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:35.925 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T05:38:35.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:38:35.925 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:35.940 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:38:35.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:38:35.940 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:35.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-19T05:38:36.063 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:36.120 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-19T05:38:36.120 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-19T05:38:36.120 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-19T05:38:36.120 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-19T05:38:36.120 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:36.121 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:36.122 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:36.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:36.123 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-19T05:38:36.175 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:38:36.176 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T05:38:36.218 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-19T05:38:36.242 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:38:36.299 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-19T05:38:36.299 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-19T05:38:36.299 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-19T05:38:36.299 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-19T05:38:36.299 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-19T05:38:36.299 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-19T05:38:36.300 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:36.301 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:38:36.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:36.302 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-19T05:38:36.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-19T05:38:36.300+0000 7f0b6d4eb480 -1 init, newargv = 0x56469fc9d500 newargc=15 2024-09-19T05:38:36.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[45335]: starting ceph client 2024-09-19T05:38:36.318 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[45335]: starting fuse 2024-09-19T05:38:36.320 INFO:teuthology.orchestra.run.smithi103.stdout:41 2024-09-19T05:38:36.320 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:38:36.321 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-19T05:38:36.322 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-19T05:38:36.441 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.45335.asok 2024-09-19T05:38:36.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:38:36.452 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45335.asok 2024-09-19T05:38:36.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:36.452 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45335.asok status 2024-09-19T05:38:36.588 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "45335", 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4857, 2024-09-19T05:38:36.589 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4857 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2952326230 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:38:36.590 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2952326230 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4857 192.168.0.1:0/2952326230", 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2952326230", 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 18, 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 28, 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-19T05:38:36.591 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:36.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:36.598 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-19T05:38:36.598 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:36.613 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-19T05:38:36.614 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:36.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:38:36.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:36.679 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-19T05:38:36.698 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-19T05:38:36.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:38:36.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.819+0000 7fea2de77640 1 Processor -- start 2024-09-19T05:38:36.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.819+0000 7fea2de77640 1 -- start start 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.819+0000 7fea2de77640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fea280c3a50 0x7fea280c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.819+0000 7fea2de77640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2815bc80 con 0x7fea28151ea0 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.819+0000 7fea2de77640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea28157c70 con 0x7fea280c46c0 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.819+0000 7fea2de77640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fea281585a0 con 0x7fea280c3a50 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea277fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fea28151ea0 0x7fea28158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40816/0 (socket says 172.21.15.103:40816) 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea277fe640 1 -- 172.21.15.103:0/2040421757 learned_addr learned my addr 172.21.15.103:0/2040421757 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea27fff640 1 --2- 172.21.15.103:0/2040421757 >> v2:172.21.15.174:3300/0 conn(0x7fea280c3a50 0x7fea280c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898383743 0 0) 0x7fea2815bc80 con 0x7fea28151ea0 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea10003520 con 0x7fea28151ea0 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066319907 0 0) 0x7fea28157c70 con 0x7fea280c46c0 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea2815bc80 con 0x7fea280c46c0 2024-09-19T05:38:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea27fff640 1 -- 172.21.15.103:0/2040421757 >> v1:172.21.15.174:6789/0 conn(0x7fea280c46c0 legacy=0x7fea2806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea27fff640 1 -- 172.21.15.103:0/2040421757 >> v1:172.21.15.103:6789/0 conn(0x7fea28151ea0 legacy=0x7fea28158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2820438890 0 0) 0x7fea10003520 con 0x7fea28151ea0 2024-09-19T05:38:36.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.820+0000 7fea27fff640 1 -- 172.21.15.103:0/2040421757 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea28157f50 con 0x7fea280c3a50 2024-09-19T05:38:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.821+0000 7fea27fff640 1 --2- 172.21.15.103:0/2040421757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c3a50 0x7fea280c89b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea20009d90 tx=0x7fea2002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa808b3330676a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.821+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18001670 con 0x7fea280c3a50 2024-09-19T05:38:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.821+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20007540 con 0x7fea280c3a50 2024-09-19T05:38:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.821+0000 7fea267fc640 1 -- 172.21.15.103:0/2040421757 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea200078f0 con 0x7fea280c3a50 2024-09-19T05:38:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.822+0000 7fea2de77640 1 -- 172.21.15.103:0/2040421757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c3a50 msgr2=0x7fea280c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.822+0000 7fea2de77640 1 --2- 172.21.15.103:0/2040421757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c3a50 0x7fea280c89b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea20009d90 tx=0x7fea2002a710 comp rx=0 tx=0).stop 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.822+0000 7fea2de77640 1 -- 172.21.15.103:0/2040421757 shutdown_connections 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.822+0000 7fea2de77640 1 --2- 172.21.15.103:0/2040421757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c3a50 0x7fea280c89b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.822+0000 7fea2de77640 1 -- 172.21.15.103:0/2040421757 >> 172.21.15.103:0/2040421757 conn(0x7fea280c9230 msgr2=0x7fea280c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.822+0000 7fea2de77640 1 -- 172.21.15.103:0/2040421757 shutdown_connections 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.822+0000 7fea2de77640 1 -- 172.21.15.103:0/2040421757 wait complete. 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.823+0000 7fea2de77640 1 Processor -- start 2024-09-19T05:38:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.823+0000 7fea2de77640 1 -- start start 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea2de77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea280c3a50 0x7fea281e2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea2de77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c46c0 0x7fea280ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea2de77640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28151ea0 0x7fea280c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea2de77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fea281596e0 con 0x7fea280c3a50 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea2de77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fea28152280 con 0x7fea280c46c0 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea2de77640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fea28158a30 con 0x7fea28151ea0 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea280c3a50 0x7fea281e2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea280c3a50 0x7fea281e2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57150/0 (socket says 172.21.15.103:57150) 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 -- 172.21.15.103:0/1750473728 learned_addr learned my addr 172.21.15.103:0/1750473728 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:36.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea27fff640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28151ea0 0x7fea280c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 -- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28151ea0 msgr2=0x7fea280c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea26ffd640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c46c0 0x7fea280ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28151ea0 0x7fea280c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 -- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c46c0 msgr2=0x7fea280ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c46c0 0x7fea280ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 -- 172.21.15.103:0/1750473728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2814c4e0 con 0x7fea280c3a50 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.824+0000 7fea277fe640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea280c3a50 0x7fea281e2250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c5d0 tx=0x7fea1800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.825+0000 7fea0ffff640 1 -- 172.21.15.103:0/1750473728 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18017070 con 0x7fea280c3a50 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.825+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea28159d50 con 0x7fea280c3a50 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.825+0000 7fea0ffff640 1 -- 172.21.15.103:0/1750473728 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea18005d00 con 0x7fea280c3a50 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.825+0000 7fea0ffff640 1 -- 172.21.15.103:0/1750473728 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea180072b0 con 0x7fea280c3a50 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.825+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea280ca3f0 con 0x7fea280c3a50 2024-09-19T05:38:36.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.826+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea28071b70 con 0x7fea280c3a50 2024-09-19T05:38:36.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.827+0000 7fea0ffff640 1 -- 172.21.15.103:0/1750473728 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fea1801a070 con 0x7fea280c3a50 2024-09-19T05:38:36.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.827+0000 7fea0ffff640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:36.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.827+0000 7fea0ffff640 1 -- 172.21.15.103:0/1750473728 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fea1808ad60 con 0x7fea280c3a50 2024-09-19T05:38:36.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.827+0000 7fea26ffd640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:36.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.828+0000 7fea26ffd640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fea1406c2b0 0x7fea1406e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0010e0 tx=0x7fea1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:36.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:36.832+0000 7fea0ffff640 1 -- 172.21.15.103:0/1750473728 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fea18059050 con 0x7fea280c3a50 2024-09-19T05:38:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.003+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea2815bf20 con 0x7fea280c3a50 2024-09-19T05:38:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.004+0000 7fea0ffff640 1 -- 172.21.15.103:0/1750473728 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+19059 (secure 0 0 0) 0x7fea18058950 con 0x7fea280c3a50 2024-09-19T05:38:37.007 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:37.007 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:38:25.956806+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:38:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fea1406c2b0 msgr2=0x7fea1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fea1406c2b0 0x7fea1406e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0010e0 tx=0x7fea1c009040 comp rx=0 tx=0).stop 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea280c3a50 msgr2=0x7fea281e2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea280c3a50 0x7fea281e2250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c5d0 tx=0x7fea1800ca90 comp rx=0 tx=0).stop 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 shutdown_connections 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28151ea0 0x7fea280c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea280c46c0 0x7fea280ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 --2- 172.21.15.103:0/1750473728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea280c3a50 0x7fea281e2250 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 >> 172.21.15.103:0/1750473728 conn(0x7fea280c9230 msgr2=0x7fea2806ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 shutdown_connections 2024-09-19T05:38:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.006+0000 7fea2de77640 1 -- 172.21.15.103:0/1750473728 wait complete. 2024-09-19T05:38:37.020 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:37:32.203807+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T05:37:40.937896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T05:37:42.096929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T05:37:45.811313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T05:38:37.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:38:37.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.121+0000 7fdaa9f31640 1 Processor -- start 2024-09-19T05:38:37.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.121+0000 7fdaa9f31640 1 -- start start 2024-09-19T05:38:37.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa9f31640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdaa4155260 0x7fdaa415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa9f31640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdaa406ee90 0x7fdaa415c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa9f31640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa4072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa9f31640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa415be10 con 0x7fdaa4155260 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa9f31640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa415e560 con 0x7fdaa406ee90 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa9f31640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa4070e50 con 0x7fdaa415b8b0 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdaa4155260 0x7fdaa415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdaa4155260 0x7fdaa415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57154/0 (socket says 172.21.15.103:57154) 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1321842324 learned_addr learned my addr 172.21.15.103:0/1321842324 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fda9affd640 1 --2- 172.21.15.103:0/1321842324 >> v2:172.21.15.174:3300/0 conn(0x7fdaa406ee90 0x7fdaa415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa3fff640 1 --2- 172.21.15.103:0/1321842324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa4072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1321842324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 msgr2=0x7fdaa4072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 --2- 172.21.15.103:0/1321842324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa4072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1321842324 >> v2:172.21.15.174:3300/0 conn(0x7fdaa406ee90 msgr2=0x7fdaa415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 --2- 172.21.15.103:0/1321842324 >> v2:172.21.15.174:3300/0 conn(0x7fdaa406ee90 0x7fdaa415c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.122+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1321842324 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa415e800 con 0x7fdaa4155260 2024-09-19T05:38:37.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.123+0000 7fdaa37fe640 1 --2- 172.21.15.103:0/1321842324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4155260 0x7fdaa415c3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdaa406e030 tx=0x7fda9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb58aa82e6e61669 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.123+0000 7fdaa2ffd640 1 -- 172.21.15.103:0/1321842324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94037070 con 0x7fdaa4155260 2024-09-19T05:38:37.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.123+0000 7fdaa2ffd640 1 -- 172.21.15.103:0/1321842324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94032440 con 0x7fdaa4155260 2024-09-19T05:38:37.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.123+0000 7fdaa2ffd640 1 -- 172.21.15.103:0/1321842324 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94032810 con 0x7fdaa4155260 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1321842324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4155260 msgr2=0x7fdaa415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1321842324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4155260 0x7fdaa415c3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdaa406e030 tx=0x7fda9402a270 comp rx=0 tx=0).stop 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1321842324 shutdown_connections 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1321842324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa4072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1321842324 >> v2:172.21.15.174:3300/0 conn(0x7fdaa406ee90 0x7fdaa415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1321842324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4155260 0x7fdaa415c3c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1321842324 >> 172.21.15.103:0/1321842324 conn(0x7fdaa406cd20 msgr2=0x7fdaa406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1321842324 shutdown_connections 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.124+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1321842324 wait complete. 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.125+0000 7fdaa9f31640 1 Processor -- start 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.125+0000 7fdaa9f31640 1 -- start start 2024-09-19T05:38:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa9f31640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa406ee90 0x7fdaa4158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa9f31640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa4155260 0x7fdaa4159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa9f31640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa40c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa9f31640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa415f0a0 con 0x7fdaa406ee90 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa9f31640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa415edc0 con 0x7fdaa4155260 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa9f31640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa40729c0 con 0x7fdaa415b8b0 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa406ee90 0x7fdaa4158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa406ee90 0x7fdaa4158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57170/0 (socket says 172.21.15.103:57170) 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1729568214 learned_addr learned my addr 172.21.15.103:0/1729568214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fda9affd640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa4155260 0x7fdaa4159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa3fff640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa40c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 msgr2=0x7fdaa40c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa40c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa4155260 msgr2=0x7fdaa4159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa4155260 0x7fdaa4159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa37fe640 1 -- 172.21.15.103:0/1729568214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa415a5e0 con 0x7fdaa406ee90 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.126+0000 7fdaa3fff640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa40c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.127+0000 7fdaa37fe640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa406ee90 0x7fdaa4158470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fda9402a2b0 tx=0x7fda940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.127+0000 7fdaa0ff9640 1 -- 172.21.15.103:0/1729568214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94041020 con 0x7fdaa406ee90 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.127+0000 7fdaa0ff9640 1 -- 172.21.15.103:0/1729568214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda940306c0 con 0x7fdaa406ee90 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.127+0000 7fdaa0ff9640 1 -- 172.21.15.103:0/1729568214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94037040 con 0x7fdaa406ee90 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.127+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa415a8c0 con 0x7fdaa406ee90 2024-09-19T05:38:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.127+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa4158b30 con 0x7fdaa406ee90 2024-09-19T05:38:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.128+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa40ccf10 con 0x7fdaa406ee90 2024-09-19T05:38:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.128+0000 7fdaa0ff9640 1 -- 172.21.15.103:0/1729568214 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda94044020 con 0x7fdaa406ee90 2024-09-19T05:38:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.129+0000 7fdaa0ff9640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fda8406c2b0 0x7fda8406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.129+0000 7fda9affd640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fda8406c2b0 0x7fda8406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.129+0000 7fdaa0ff9640 1 -- 172.21.15.103:0/1729568214 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fda940abfc0 con 0x7fdaa406ee90 2024-09-19T05:38:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.129+0000 7fda9affd640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fda8406c2b0 0x7fda8406e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdaa41589b0 tx=0x7fda8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.133+0000 7fdaa0ff9640 1 -- 172.21.15.103:0/1729568214 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdaa40ccf10 con 0x7fdaa406ee90 2024-09-19T05:38:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.309+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdaa4072480 con 0x7fdaa406ee90 2024-09-19T05:38:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.309+0000 7fdaa0ff9640 1 -- 172.21.15.103:0/1729568214 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fda9404b030 con 0x7fdaa406ee90 2024-09-19T05:38:37.312 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-19T05:38:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.311+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fda8406c2b0 msgr2=0x7fda8406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.311+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fda8406c2b0 0x7fda8406e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdaa41589b0 tx=0x7fda8c008040 comp rx=0 tx=0).stop 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.311+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa406ee90 msgr2=0x7fdaa4158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.311+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa406ee90 0x7fdaa4158470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fda9402a2b0 tx=0x7fda940046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 shutdown_connections 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fda8406c2b0 0x7fda8406e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa415b8b0 0x7fdaa40c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa4155260 0x7fdaa4159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 --2- 172.21.15.103:0/1729568214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa406ee90 0x7fdaa4158470 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 >> 172.21.15.103:0/1729568214 conn(0x7fdaa406cd20 msgr2=0x7fdaa415c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 shutdown_connections 2024-09-19T05:38:37.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.312+0000 7fdaa9f31640 1 -- 172.21.15.103:0/1729568214 wait complete. 2024-09-19T05:38:37.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T05:38:37.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.429+0000 7fb113fc4640 1 Processor -- start 2024-09-19T05:38:37.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.429+0000 7fb113fc4640 1 -- start start 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb113fc4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb10c068380 0x7fb10c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb113fc4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb10c073bd0 0x7fb10c074000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb113fc4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb10c0caa60 con 0x7fb10c155090 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb113fc4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb10c073740 con 0x7fb10c068380 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb113fc4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fb10c074540 con 0x7fb10c073bd0 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb11155f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb10c068380 0x7fb10c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb11155f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb10c068380 0x7fb10c15ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57184/0 (socket says 172.21.15.103:57184) 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb11155f640 1 -- 172.21.15.103:0/3058989395 learned_addr learned my addr 172.21.15.103:0/3058989395 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb112561640 1 --2- 172.21.15.103:0/3058989395 >> v2:172.21.15.174:3300/0 conn(0x7fb10c073bd0 0x7fb10c074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb11155f640 1 -- 172.21.15.103:0/3058989395 >> v2:172.21.15.174:3300/0 conn(0x7fb10c073bd0 msgr2=0x7fb10c074000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb11155f640 1 --2- 172.21.15.103:0/3058989395 >> v2:172.21.15.174:3300/0 conn(0x7fb10c073bd0 0x7fb10c074000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb11155f640 1 -- 172.21.15.103:0/3058989395 >> v1:172.21.15.174:6789/0 conn(0x7fb10c155090 legacy=0x7fb10c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:37.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb11155f640 1 -- 172.21.15.103:0/3058989395 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c0c9ee0 con 0x7fb10c068380 2024-09-19T05:38:37.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.430+0000 7fb112561640 1 --2- 172.21.15.103:0/3058989395 >> v2:172.21.15.174:3300/0 conn(0x7fb10c073bd0 0x7fb10c074000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb11155f640 1 --2- 172.21.15.103:0/3058989395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c068380 0x7fb10c15ae70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb10c06e280 tx=0x7fb10802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498ca1e0397dbcca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb110d5e640 1 -- 172.21.15.103:0/3058989395 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108037070 con 0x7fb10c068380 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb110d5e640 1 -- 172.21.15.103:0/3058989395 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108032440 con 0x7fb10c068380 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb110d5e640 1 -- 172.21.15.103:0/3058989395 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108032810 con 0x7fb10c068380 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb113fc4640 1 -- 172.21.15.103:0/3058989395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c068380 msgr2=0x7fb10c15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb113fc4640 1 --2- 172.21.15.103:0/3058989395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c068380 0x7fb10c15ae70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb10c06e280 tx=0x7fb10802a2c0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb113fc4640 1 -- 172.21.15.103:0/3058989395 shutdown_connections 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb113fc4640 1 --2- 172.21.15.103:0/3058989395 >> v2:172.21.15.174:3300/0 conn(0x7fb10c073bd0 0x7fb10c074000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb113fc4640 1 --2- 172.21.15.103:0/3058989395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c068380 0x7fb10c15ae70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.431+0000 7fb113fc4640 1 -- 172.21.15.103:0/3058989395 >> 172.21.15.103:0/3058989395 conn(0x7fb10c067890 msgr2=0x7fb10c067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:37.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.432+0000 7fb113fc4640 1 -- 172.21.15.103:0/3058989395 shutdown_connections 2024-09-19T05:38:37.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.432+0000 7fb113fc4640 1 -- 172.21.15.103:0/3058989395 wait complete. 2024-09-19T05:38:37.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 Processor -- start 2024-09-19T05:38:37.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 -- start start 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10c068380 0x7fb10c15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c073bd0 0x7fb10c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10c155090 0x7fb10c1f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c0ca780 con 0x7fb10c073bd0 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c0ca4a0 con 0x7fb10c068380 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb113fc4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c06d820 con 0x7fb10c155090 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb11155f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c073bd0 0x7fb10c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.433+0000 7fb11155f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c073bd0 0x7fb10c1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57198/0 (socket says 172.21.15.103:57198) 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb11155f640 1 -- 172.21.15.103:0/238215016 learned_addr learned my addr 172.21.15.103:0/238215016 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb111d60640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10c068380 0x7fb10c15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb112561640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10c155090 0x7fb10c1f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb11155f640 1 -- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10c155090 msgr2=0x7fb10c1f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb11155f640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10c155090 0x7fb10c1f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb11155f640 1 -- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10c068380 msgr2=0x7fb10c15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb11155f640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10c068380 0x7fb10c15d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb11155f640 1 -- 172.21.15.103:0/238215016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c15f270 con 0x7fb10c073bd0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb112561640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10c155090 0x7fb10c1f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb11155f640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c073bd0 0x7fb10c1598e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb10802a300 tx=0x7fb1080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb0fe7fc640 1 -- 172.21.15.103:0/238215016 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108037040 con 0x7fb10c073bd0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb0fe7fc640 1 -- 172.21.15.103:0/238215016 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108042070 con 0x7fb10c073bd0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb0fe7fc640 1 -- 172.21.15.103:0/238215016 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108030bb0 con 0x7fb10c073bd0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c15efb0 con 0x7fb10c073bd0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.434+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c15b6c0 con 0x7fb10c073bd0 2024-09-19T05:38:37.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.435+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10c155470 con 0x7fb10c073bd0 2024-09-19T05:38:37.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.436+0000 7fb0fe7fc640 1 -- 172.21.15.103:0/238215016 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb108047460 con 0x7fb10c073bd0 2024-09-19T05:38:37.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.436+0000 7fb0fe7fc640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb0f006c2b0 0x7fb0f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.436+0000 7fb0fe7fc640 1 -- 172.21.15.103:0/238215016 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb1080ac2c0 con 0x7fb10c073bd0 2024-09-19T05:38:37.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.436+0000 7fb111d60640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb0f006c2b0 0x7fb0f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.437+0000 7fb111d60640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb0f006c2b0 0x7fb0f006e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb100006fd0 tx=0x7fb100009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.441+0000 7fb0fe7fc640 1 -- 172.21.15.103:0/238215016 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb10807a6c0 con 0x7fb10c073bd0 2024-09-19T05:38:37.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.605+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb10c070f20 con 0x7fb10c073bd0 2024-09-19T05:38:37.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.605+0000 7fb0fe7fc640 1 -- 172.21.15.103:0/238215016 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fb108079fc0 con 0x7fb10c073bd0 2024-09-19T05:38:37.608 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-19T05:38:37.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb0f006c2b0 msgr2=0x7fb0f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb0f006c2b0 0x7fb0f006e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb100006fd0 tx=0x7fb100009060 comp rx=0 tx=0).stop 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c073bd0 msgr2=0x7fb10c1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c073bd0 0x7fb10c1598e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb10802a300 tx=0x7fb1080046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 shutdown_connections 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb0f006c2b0 0x7fb0f006e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10c155090 0x7fb10c1f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb10c073bd0 0x7fb10c1598e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 --2- 172.21.15.103:0/238215016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10c068380 0x7fb10c15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 >> 172.21.15.103:0/238215016 conn(0x7fb10c067890 msgr2=0x7fb10c0cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 shutdown_connections 2024-09-19T05:38:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.607+0000 7fb113fc4640 1 -- 172.21.15.103:0/238215016 wait complete. 2024-09-19T05:38:37.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T05:38:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.720+0000 7f75e7053640 1 Processor -- start 2024-09-19T05:38:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.720+0000 7f75e7053640 1 -- start start 2024-09-19T05:38:37.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.720+0000 7f75e7053640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f75e0153120 0x7f75e0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.720+0000 7f75e7053640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e00c55c0 0x7f75e00c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.720+0000 7f75e7053640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e00c8030 con 0x7f75e0152d40 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.720+0000 7f75e7053640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f75e00c6120 con 0x7f75e0153120 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.720+0000 7f75e7053640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f75e00c6400 con 0x7f75e00c55c0 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75dffff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f75e0153120 0x7f75e0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75e55f0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e00c55c0 0x7f75e00c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75dffff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f75e0153120 0x7f75e0158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38040/0 (socket says 172.21.15.103:38040) 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75e55f0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e00c55c0 0x7f75e00c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:41714/0 (socket says 172.21.15.103:41714) 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75dffff640 1 -- 172.21.15.103:0/1767133373 learned_addr learned my addr 172.21.15.103:0/1767133373 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75e4def640 1 --1- 172.21.15.103:0/1767133373 >> v1:172.21.15.174:6789/0 conn(0x7f75e0152d40 0x7f75e00c92c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:55832/0 (socket says 172.21.15.103:55832) 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75dffff640 1 -- 172.21.15.103:0/1767133373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e00c55c0 msgr2=0x7f75e00c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75dffff640 1 --2- 172.21.15.103:0/1767133373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e00c55c0 0x7f75e00c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75dffff640 1 -- 172.21.15.103:0/1767133373 >> v1:172.21.15.174:6789/0 conn(0x7f75e0152d40 legacy=0x7f75e00c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.721+0000 7f75dffff640 1 -- 172.21.15.103:0/1767133373 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e00c66e0 con 0x7f75e0153120 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.722+0000 7f75dffff640 1 --2- 172.21.15.103:0/1767133373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0153120 0x7f75e0158bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009e50 tx=0x7f75d002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9440f79f19805493 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.722+0000 7f75df7fe640 1 -- 172.21.15.103:0/1767133373 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0036070 con 0x7f75e0153120 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.722+0000 7f75df7fe640 1 -- 172.21.15.103:0/1767133373 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d0031600 con 0x7f75e0153120 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.722+0000 7f75df7fe640 1 -- 172.21.15.103:0/1767133373 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00319d0 con 0x7f75e0153120 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 -- 172.21.15.103:0/1767133373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0153120 msgr2=0x7f75e0158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 --2- 172.21.15.103:0/1767133373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0153120 0x7f75e0158bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009e50 tx=0x7f75d002a710 comp rx=0 tx=0).stop 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 -- 172.21.15.103:0/1767133373 shutdown_connections 2024-09-19T05:38:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 --2- 172.21.15.103:0/1767133373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e00c55c0 0x7f75e00c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 --2- 172.21.15.103:0/1767133373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0153120 0x7f75e0158bb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 -- 172.21.15.103:0/1767133373 >> 172.21.15.103:0/1767133373 conn(0x7f75e0073950 msgr2=0x7f75e006f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 -- 172.21.15.103:0/1767133373 shutdown_connections 2024-09-19T05:38:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.723+0000 7f75e7053640 1 -- 172.21.15.103:0/1767133373 wait complete. 2024-09-19T05:38:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.724+0000 7f75e7053640 1 Processor -- start 2024-09-19T05:38:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.724+0000 7f75e7053640 1 -- start start 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75e00c55c0 0x7f75e0156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0152d40 0x7f75e0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e0153120 0x7f75e01f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75e00ce830 con 0x7f75e00c55c0 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f75e00c5dc0 con 0x7f75e0152d40 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f75e00ce9b0 con 0x7f75e0153120 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75e00c55c0 0x7f75e0156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75e00c55c0 0x7f75e0156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57212/0 (socket says 172.21.15.103:57212) 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 -- 172.21.15.103:0/2482598885 learned_addr learned my addr 172.21.15.103:0/2482598885 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75dffff640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0152d40 0x7f75e0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e55f0640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e0153120 0x7f75e01f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 -- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e0153120 msgr2=0x7f75e01f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e0153120 0x7f75e01f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 -- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0152d40 msgr2=0x7f75e0157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0152d40 0x7f75e0157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 -- 172.21.15.103:0/2482598885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e0153a50 con 0x7f75e00c55c0 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e55f0640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e0153120 0x7f75e01f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e4def640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75e00c55c0 0x7f75e0156270 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c430 tx=0x7f75d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75dd7fa640 1 -- 172.21.15.103:0/2482598885 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d80074e0 con 0x7f75e00c55c0 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75dd7fa640 1 -- 172.21.15.103:0/2482598885 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d8007680 con 0x7f75e00c55c0 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e0152500 con 0x7f75e00c55c0 2024-09-19T05:38:37.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75dd7fa640 1 -- 172.21.15.103:0/2482598885 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8004a00 con 0x7f75e00c55c0 2024-09-19T05:38:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.725+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e01462c0 con 0x7f75e00c55c0 2024-09-19T05:38:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.727+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e0153500 con 0x7f75e00c55c0 2024-09-19T05:38:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.727+0000 7f75dd7fa640 1 -- 172.21.15.103:0/2482598885 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75d801a020 con 0x7f75e00c55c0 2024-09-19T05:38:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.727+0000 7f75dd7fa640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75c006c2b0 0x7f75c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.728+0000 7f75dffff640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75c006c2b0 0x7f75c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.728+0000 7f75dd7fa640 1 -- 172.21.15.103:0/2482598885 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f75d808afb0 con 0x7f75e00c55c0 2024-09-19T05:38:37.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.728+0000 7f75dffff640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75c006c2b0 0x7f75c006e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75d0033000 tx=0x7f75d0009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.732+0000 7f75dd7fa640 1 -- 172.21.15.103:0/2482598885 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f75d8059320 con 0x7f75e00c55c0 2024-09-19T05:38:37.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.898+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75e0146490 con 0x7f75e00c55c0 2024-09-19T05:38:37.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.898+0000 7f75dd7fa640 1 -- 172.21.15.103:0/2482598885 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f75d8058c20 con 0x7f75e00c55c0 2024-09-19T05:38:37.900 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-09-19T05:38:37.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75c006c2b0 msgr2=0x7f75c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75c006c2b0 0x7f75c006e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75d0033000 tx=0x7f75d0009000 comp rx=0 tx=0).stop 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75e00c55c0 msgr2=0x7f75e0156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75e00c55c0 0x7f75e0156270 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c430 tx=0x7f75d800c8f0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 shutdown_connections 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f75c006c2b0 0x7f75c006e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75e0153120 0x7f75e01f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75e0152d40 0x7f75e0157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 --2- 172.21.15.103:0/2482598885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75e00c55c0 0x7f75e0156270 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 >> 172.21.15.103:0/2482598885 conn(0x7f75e0073950 msgr2=0x7f75e0151550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 shutdown_connections 2024-09-19T05:38:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:37.900+0000 7f75e7053640 1 -- 172.21.15.103:0/2482598885 wait complete. 2024-09-19T05:38:37.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T05:38:38.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.014+0000 7fd4bd5a6640 1 Processor -- start 2024-09-19T05:38:38.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.014+0000 7fd4bd5a6640 1 -- start start 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4bd5a6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4b8154f30 0x7fd4b80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4bd5a6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ae50 0x7fd4b815b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4bd5a6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4b815b7c0 con 0x7fd4b815ed00 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4bd5a6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b80cbe80 con 0x7fd4b8154f30 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4bd5a6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b80cc0d0 con 0x7fd4b815ae50 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4b77fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ae50 0x7fd4b815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4b6ffd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4b8154f30 0x7fd4b80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4affff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd4b815ed00 0x7fd4b806db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:55846/0 (socket says 172.21.15.103:55846) 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4affff640 1 -- 172.21.15.103:0/2370058087 learned_addr learned my addr 172.21.15.103:0/2370058087 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:38.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4b77fe640 1 -- 172.21.15.103:0/2370058087 >> v2:172.21.15.174:3300/0 conn(0x7fd4b8154f30 msgr2=0x7fd4b80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4b77fe640 1 --2- 172.21.15.103:0/2370058087 >> v2:172.21.15.174:3300/0 conn(0x7fd4b8154f30 0x7fd4b80cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.015+0000 7fd4b77fe640 1 -- 172.21.15.103:0/2370058087 >> v1:172.21.15.174:6789/0 conn(0x7fd4b815ed00 legacy=0x7fd4b806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.016+0000 7fd4b77fe640 1 -- 172.21.15.103:0/2370058087 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b80cc3b0 con 0x7fd4b815ae50 2024-09-19T05:38:38.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.016+0000 7fd4b6ffd640 1 --2- 172.21.15.103:0/2370058087 >> v2:172.21.15.174:3300/0 conn(0x7fd4b8154f30 0x7fd4b80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.016+0000 7fd4b77fe640 1 --2- 172.21.15.103:0/2370058087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ae50 0x7fd4b815b280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009d90 tx=0x7fd4b002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2de7d8fde90f65cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.016+0000 7fd4b67fc640 1 -- 172.21.15.103:0/2370058087 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0007740 con 0x7fd4b815ae50 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.016+0000 7fd4b67fc640 1 -- 172.21.15.103:0/2370058087 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b00078e0 con 0x7fd4b815ae50 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.016+0000 7fd4b67fc640 1 -- 172.21.15.103:0/2370058087 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0007cb0 con 0x7fd4b815ae50 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/2370058087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ae50 msgr2=0x7fd4b815b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/2370058087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ae50 0x7fd4b815b280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009d90 tx=0x7fd4b002a6f0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/2370058087 shutdown_connections 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/2370058087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ae50 0x7fd4b815b280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/2370058087 >> v2:172.21.15.174:3300/0 conn(0x7fd4b8154f30 0x7fd4b80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/2370058087 >> 172.21.15.103:0/2370058087 conn(0x7fd4b806bd10 msgr2=0x7fd4b806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/2370058087 shutdown_connections 2024-09-19T05:38:38.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.017+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/2370058087 wait complete. 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.018+0000 7fd4bd5a6640 1 Processor -- start 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.018+0000 7fd4bd5a6640 1 -- start start 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4bd5a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b8154f30 0x7fd4b8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4bd5a6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b815ae50 0x7fd4b815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4bd5a6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ed00 0x7fd4b815cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4bd5a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b80b3590 con 0x7fd4b8154f30 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4bd5a6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b80cb590 con 0x7fd4b815ae50 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4bd5a6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b815f130 con 0x7fd4b815ed00 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b8154f30 0x7fd4b8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b8154f30 0x7fd4b8159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57228/0 (socket says 172.21.15.103:57228) 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 -- 172.21.15.103:0/245885287 learned_addr learned my addr 172.21.15.103:0/245885287 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b77fe640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ed00 0x7fd4b815cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4affff640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b815ae50 0x7fd4b815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 -- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ed00 msgr2=0x7fd4b815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ed00 0x7fd4b815cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 -- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b815ae50 msgr2=0x7fd4b815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b815ae50 0x7fd4b815c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 -- 172.21.15.103:0/245885287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b815a460 con 0x7fd4b8154f30 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.019+0000 7fd4b6ffd640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b8154f30 0x7fd4b8159c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800ebe0 tx=0x7fd4a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.020+0000 7fd4af7fe640 1 -- 172.21.15.103:0/245885287 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8017070 con 0x7fd4b8154f30 2024-09-19T05:38:38.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.020+0000 7fd4af7fe640 1 -- 172.21.15.103:0/245885287 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a800cc30 con 0x7fd4b8154f30 2024-09-19T05:38:38.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.020+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b815a740 con 0x7fd4b8154f30 2024-09-19T05:38:38.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.020+0000 7fd4af7fe640 1 -- 172.21.15.103:0/245885287 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8013470 con 0x7fd4b8154f30 2024-09-19T05:38:38.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.020+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b815bdc0 con 0x7fd4b8154f30 2024-09-19T05:38:38.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.021+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b81527c0 con 0x7fd4b8154f30 2024-09-19T05:38:38.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.021+0000 7fd4af7fe640 1 -- 172.21.15.103:0/245885287 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4a801a070 con 0x7fd4b8154f30 2024-09-19T05:38:38.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.022+0000 7fd4af7fe640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd49806c2b0 0x7fd49806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.022+0000 7fd4af7fe640 1 -- 172.21.15.103:0/245885287 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd4a808b730 con 0x7fd4b8154f30 2024-09-19T05:38:38.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.022+0000 7fd4affff640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd49806c2b0 0x7fd49806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.022+0000 7fd4affff640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd49806c2b0 0x7fd49806e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8068fa0 tx=0x7fd4a0007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.026+0000 7fd4af7fe640 1 -- 172.21.15.103:0/245885287 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd4b81527c0 con 0x7fd4b8154f30 2024-09-19T05:38:38.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.191+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd4b8155310 con 0x7fd4b8154f30 2024-09-19T05:38:38.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.191+0000 7fd4af7fe640 1 -- 172.21.15.103:0/245885287 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fd4a8059450 con 0x7fd4b8154f30 2024-09-19T05:38:38.194 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd49806c2b0 msgr2=0x7fd49806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd49806c2b0 0x7fd49806e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8068fa0 tx=0x7fd4a0007e80 comp rx=0 tx=0).stop 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b8154f30 msgr2=0x7fd4b8159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b8154f30 0x7fd4b8159c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800ebe0 tx=0x7fd4a800c520 comp rx=0 tx=0).stop 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 shutdown_connections 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd49806c2b0 0x7fd49806e770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4b815ed00 0x7fd4b815cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b815ae50 0x7fd4b815c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 --2- 172.21.15.103:0/245885287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b8154f30 0x7fd4b8159c20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 >> 172.21.15.103:0/245885287 conn(0x7fd4b806bd10 msgr2=0x7fd4b80c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 shutdown_connections 2024-09-19T05:38:38.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.193+0000 7fd4bd5a6640 1 -- 172.21.15.103:0/245885287 wait complete. 2024-09-19T05:38:38.207 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-19T05:38:38.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:38.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.303+0000 7f3964865640 1 Processor -- start 2024-09-19T05:38:38.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.304+0000 7f3964865640 1 -- start start 2024-09-19T05:38:38.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.304+0000 7f3964865640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39600b3540 0x7f39600cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.304+0000 7f3964865640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f39600c5950 0x7f39600cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.304+0000 7f3964865640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39600cbed0 con 0x7f3960155040 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f3964865640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f396015bd70 con 0x7f39600b3540 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f3964865640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f39600cbbf0 con 0x7f39600c5950 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395dd9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39600b3540 0x7f39600cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395e59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3960155040 0x7f396015e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40824/0 (socket says 172.21.15.103:40824) 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395dd9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39600b3540 0x7f39600cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57230/0 (socket says 172.21.15.103:57230) 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395e59c640 1 -- 172.21.15.103:0/3173913946 learned_addr learned my addr 172.21.15.103:0/3173913946 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395dd9b640 1 -- 172.21.15.103:0/3173913946 >> v2:172.21.15.174:3300/0 conn(0x7f39600c5950 msgr2=0x7f39600cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395ed9d640 1 --2- 172.21.15.103:0/3173913946 >> v2:172.21.15.174:3300/0 conn(0x7f39600c5950 0x7f39600cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395dd9b640 1 --2- 172.21.15.103:0/3173913946 >> v2:172.21.15.174:3300/0 conn(0x7f39600c5950 0x7f39600cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395dd9b640 1 -- 172.21.15.103:0/3173913946 >> v1:172.21.15.103:6789/0 conn(0x7f3960155040 legacy=0x7f396015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395dd9b640 1 -- 172.21.15.103:0/3173913946 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396015afb0 con 0x7f39600b3540 2024-09-19T05:38:38.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395d59a640 1 -- 172.21.15.103:0/3173913946 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046428764 0 0) 0x7f39600cbed0 con 0x7f3960155040 2024-09-19T05:38:38.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.305+0000 7f395ed9d640 1 --2- 172.21.15.103:0/3173913946 >> v2:172.21.15.174:3300/0 conn(0x7f39600c5950 0x7f39600cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f395dd9b640 1 --2- 172.21.15.103:0/3173913946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600b3540 0x7f39600cb540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3960158a00 tx=0x7f394802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f899df05999e193a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f395d59a640 1 -- 172.21.15.103:0/3173913946 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948037070 con 0x7f39600b3540 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f395d59a640 1 -- 172.21.15.103:0/3173913946 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3948032440 con 0x7f39600b3540 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f395d59a640 1 -- 172.21.15.103:0/3173913946 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948032810 con 0x7f39600b3540 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 -- 172.21.15.103:0/3173913946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600b3540 msgr2=0x7f39600cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 --2- 172.21.15.103:0/3173913946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600b3540 0x7f39600cb540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3960158a00 tx=0x7f394802a230 comp rx=0 tx=0).stop 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 -- 172.21.15.103:0/3173913946 shutdown_connections 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 --2- 172.21.15.103:0/3173913946 >> v2:172.21.15.174:3300/0 conn(0x7f39600c5950 0x7f39600cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 --2- 172.21.15.103:0/3173913946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600b3540 0x7f39600cb540 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 -- 172.21.15.103:0/3173913946 >> 172.21.15.103:0/3173913946 conn(0x7f3960073340 msgr2=0x7f3960073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 -- 172.21.15.103:0/3173913946 shutdown_connections 2024-09-19T05:38:38.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.306+0000 7f3964865640 1 -- 172.21.15.103:0/3173913946 wait complete. 2024-09-19T05:38:38.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 Processor -- start 2024-09-19T05:38:38.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 -- start start 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39600b3540 0x7f39601e4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600c5950 0x7f39601f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3960155040 0x7f39600cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f396015b850 con 0x7f39600c5950 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f396015b570 con 0x7f39600b3540 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f3964865640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f396015eb30 con 0x7f3960155040 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.308+0000 7f395dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600c5950 0x7f39601f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600c5950 0x7f39601f11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57232/0 (socket says 172.21.15.103:57232) 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 -- 172.21.15.103:0/1641145670 learned_addr learned my addr 172.21.15.103:0/1641145670 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395e59c640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39600b3540 0x7f39601e4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395ed9d640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3960155040 0x7f39600cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 -- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3960155040 msgr2=0x7f39600cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3960155040 0x7f39600cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 -- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39600b3540 msgr2=0x7f39601e4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39600b3540 0x7f39601e4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 -- 172.21.15.103:0/1641145670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39601e4910 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f395dd9b640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600c5950 0x7f39601f11b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3948009890 tx=0x7f39480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f3956ffd640 1 -- 172.21.15.103:0/1641145670 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948037040 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f3956ffd640 1 -- 172.21.15.103:0/1641145670 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3948042070 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f3956ffd640 1 -- 172.21.15.103:0/1641145670 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948030a50 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39601e4bf0 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.309+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39601f4b30 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.310+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39600cb540 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.310+0000 7f3956ffd640 1 -- 172.21.15.103:0/1641145670 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3948030bf0 con 0x7f39600c5950 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.311+0000 7f3956ffd640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f394006c2b0 0x7f394006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.311+0000 7f3956ffd640 1 -- 172.21.15.103:0/1641145670 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f39480ac2e0 con 0x7f39600c5950 2024-09-19T05:38:38.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.311+0000 7f395e59c640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f394006c2b0 0x7f394006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.311+0000 7f395e59c640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f394006c2b0 0x7f394006e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3958007ed0 tx=0x7f3958007e60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.315+0000 7f3956ffd640 1 -- 172.21.15.103:0/1641145670 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f394807a650 con 0x7f39600c5950 2024-09-19T05:38:38.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.477+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3960069380 con 0x7f394006c2b0 2024-09-19T05:38:38.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.485+0000 7f3956ffd640 1 -- 172.21.15.103:0/1641145670 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332747 (secure 0 0 0) 0x7f3960069380 con 0x7f394006c2b0 2024-09-19T05:38:38.491 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:38.493 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:38:38.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f394006c2b0 msgr2=0x7f394006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f394006c2b0 0x7f394006e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3958007ed0 tx=0x7f3958007e60 comp rx=0 tx=0).stop 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600c5950 msgr2=0x7f39601f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600c5950 0x7f39601f11b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3948009890 tx=0x7f39480046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 shutdown_connections 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f394006c2b0 0x7f394006e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3960155040 0x7f39600cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39600c5950 0x7f39601f11b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 --2- 172.21.15.103:0/1641145670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39600b3540 0x7f39601e4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 >> 172.21.15.103:0/1641145670 conn(0x7f3960073340 msgr2=0x7f3960153010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 shutdown_connections 2024-09-19T05:38:38.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.488+0000 7f3964865640 1 -- 172.21.15.103:0/1641145670 wait complete. 2024-09-19T05:38:38.501 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-19T05:38:38.189580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":601963,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":372,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218912,"kb_used_data":2720,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755808,"statfs":{"total":773094113280,"available":772869947392,"internally_reserved":0,"allocated":2785280,"data_stored":2208547,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3519,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003022"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955633+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:38:28.955633+0000","last_peered":"2024-09-19T05:38:28.955633+0000","last_clean":"2024-09-19T05:38:28.955633+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:38:28.955633+0000","last_undegraded":"2024-09-19T05:38:28.955633+0000","last_fullsized":"2024-09-19T05:38:28.955633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965981+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:38:25.965981+0000","last_peered":"2024-09-19T05:38:25.965981+0000","last_clean":"2024-09-19T05:38:25.965981+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:38:25.965981+0000","last_undegraded":"2024-09-19T05:38:25.965981+0000","last_fullsized":"2024-09-19T05:38:25.965981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965347+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:38:25.965347+0000","last_peered":"2024-09-19T05:38:25.965347+0000","last_clean":"2024-09-19T05:38:25.965347+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:38:25.965347+0000","last_undegraded":"2024-09-19T05:38:25.965347+0000","last_fullsized":"2024-09-19T05:38:25.965347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966558+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:38:25.966558+0000","last_peered":"2024-09-19T05:38:25.966558+0000","last_clean":"2024-09-19T05:38:25.966558+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:38:25.966558+0000","last_undegraded":"2024-09-19T05:38:25.966558+0000","last_fullsized":"2024-09-19T05:38:25.966558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695184+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:38:26.695184+0000","last_peered":"2024-09-19T05:38:26.695184+0000","last_clean":"2024-09-19T05:38:26.695184+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:38:26.695184+0000","last_undegraded":"2024-09-19T05:38:26.695184+0000","last_fullsized":"2024-09-19T05:38:26.695184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963813+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:38:25.963813+0000","last_peered":"2024-09-19T05:38:25.963813+0000","last_clean":"2024-09-19T05:38:25.963813+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:38:25.963813+0000","last_undegraded":"2024-09-19T05:38:25.963813+0000","last_fullsized":"2024-09-19T05:38:25.963813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'12","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958252+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:38:28.958252+0000","last_peered":"2024-09-19T05:38:28.958252+0000","last_clean":"2024-09-19T05:38:28.958252+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:38:28.958252+0000","last_undegraded":"2024-09-19T05:38:28.958252+0000","last_fullsized":"2024-09-19T05:38:28.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363172+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:38:26.363172+0000","last_peered":"2024-09-19T05:38:26.363172+0000","last_clean":"2024-09-19T05:38:26.363172+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:38:26.363172+0000","last_undegraded":"2024-09-19T05:38:26.363172+0000","last_fullsized":"2024-09-19T05:38:26.363172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964151+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:38:25.964151+0000","last_peered":"2024-09-19T05:38:25.964151+0000","last_clean":"2024-09-19T05:38:25.964151+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:38:25.964151+0000","last_undegraded":"2024-09-19T05:38:25.964151+0000","last_fullsized":"2024-09-19T05:38:25.964151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955838+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:38:28.955838+0000","last_peered":"2024-09-19T05:38:28.955838+0000","last_clean":"2024-09-19T05:38:28.955838+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:38:28.955838+0000","last_undegraded":"2024-09-19T05:38:28.955838+0000","last_fullsized":"2024-09-19T05:38:28.955838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363062+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:38:26.363062+0000","last_peered":"2024-09-19T05:38:26.363062+0000","last_clean":"2024-09-19T05:38:26.363062+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:38:26.363062+0000","last_undegraded":"2024-09-19T05:38:26.363062+0000","last_fullsized":"2024-09-19T05:38:26.363062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963721+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:38:25.963721+0000","last_peered":"2024-09-19T05:38:25.963721+0000","last_clean":"2024-09-19T05:38:25.963721+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:38:25.963721+0000","last_undegraded":"2024-09-19T05:38:25.963721+0000","last_fullsized":"2024-09-19T05:38:25.963721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964871+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:38:25.964871+0000","last_peered":"2024-09-19T05:38:25.964871+0000","last_clean":"2024-09-19T05:38:25.964871+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:38:25.964871+0000","last_undegraded":"2024-09-19T05:38:25.964871+0000","last_fullsized":"2024-09-19T05:38:25.964871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668498+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:38:26.668498+0000","last_peered":"2024-09-19T05:38:26.668498+0000","last_clean":"2024-09-19T05:38:26.668498+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:38:26.668498+0000","last_undegraded":"2024-09-19T05:38:26.668498+0000","last_fullsized":"2024-09-19T05:38:26.668498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964520+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:38:25.964520+0000","last_peered":"2024-09-19T05:38:25.964520+0000","last_clean":"2024-09-19T05:38:25.964520+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:38:25.964520+0000","last_undegraded":"2024-09-19T05:38:25.964520+0000","last_fullsized":"2024-09-19T05:38:25.964520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965600+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:38:25.965600+0000","last_peered":"2024-09-19T05:38:25.965600+0000","last_clean":"2024-09-19T05:38:25.965600+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:38:25.965600+0000","last_undegraded":"2024-09-19T05:38:25.965600+0000","last_fullsized":"2024-09-19T05:38:25.965600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963768+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:38:25.963768+0000","last_peered":"2024-09-19T05:38:25.963768+0000","last_clean":"2024-09-19T05:38:25.963768+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:38:25.963768+0000","last_undegraded":"2024-09-19T05:38:25.963768+0000","last_fullsized":"2024-09-19T05:38:25.963768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964494+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:38:25.964494+0000","last_peered":"2024-09-19T05:38:25.964494+0000","last_clean":"2024-09-19T05:38:25.964494+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:38:25.964494+0000","last_undegraded":"2024-09-19T05:38:25.964494+0000","last_fullsized":"2024-09-19T05:38:25.964494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965262+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:38:25.965262+0000","last_peered":"2024-09-19T05:38:25.965262+0000","last_clean":"2024-09-19T05:38:25.965262+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:38:25.965262+0000","last_undegraded":"2024-09-19T05:38:25.965262+0000","last_fullsized":"2024-09-19T05:38:25.965262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954395+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:38:28.954395+0000","last_peered":"2024-09-19T05:38:28.954395+0000","last_clean":"2024-09-19T05:38:28.954395+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:38:28.954395+0000","last_undegraded":"2024-09-19T05:38:28.954395+0000","last_fullsized":"2024-09-19T05:38:28.954395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963532+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:38:25.963532+0000","last_peered":"2024-09-19T05:38:25.963532+0000","last_clean":"2024-09-19T05:38:25.963532+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:38:25.963532+0000","last_undegraded":"2024-09-19T05:38:25.963532+0000","last_fullsized":"2024-09-19T05:38:25.963532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964706+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:38:25.964706+0000","last_peered":"2024-09-19T05:38:25.964706+0000","last_clean":"2024-09-19T05:38:25.964706+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:38:25.964706+0000","last_undegraded":"2024-09-19T05:38:25.964706+0000","last_fullsized":"2024-09-19T05:38:25.964706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668515+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:26.668515+0000","last_peered":"2024-09-19T05:38:26.668515+0000","last_clean":"2024-09-19T05:38:26.668515+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:26.668515+0000","last_undegraded":"2024-09-19T05:38:26.668515+0000","last_fullsized":"2024-09-19T05:38:26.668515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964657+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:38:25.964657+0000","last_peered":"2024-09-19T05:38:25.964657+0000","last_clean":"2024-09-19T05:38:25.964657+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:38:25.964657+0000","last_undegraded":"2024-09-19T05:38:25.964657+0000","last_fullsized":"2024-09-19T05:38:25.964657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695405+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:38:26.695405+0000","last_peered":"2024-09-19T05:38:26.695405+0000","last_clean":"2024-09-19T05:38:26.695405+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:38:26.695405+0000","last_undegraded":"2024-09-19T05:38:26.695405+0000","last_fullsized":"2024-09-19T05:38:26.695405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954488+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:38:28.954488+0000","last_peered":"2024-09-19T05:38:28.954488+0000","last_clean":"2024-09-19T05:38:28.954488+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:38:28.954488+0000","last_undegraded":"2024-09-19T05:38:28.954488+0000","last_fullsized":"2024-09-19T05:38:28.954488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964312+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:38:25.964312+0000","last_peered":"2024-09-19T05:38:25.964312+0000","last_clean":"2024-09-19T05:38:25.964312+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:38:25.964312+0000","last_undegraded":"2024-09-19T05:38:25.964312+0000","last_fullsized":"2024-09-19T05:38:25.964312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966456+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:38:25.966456+0000","last_peered":"2024-09-19T05:38:25.966456+0000","last_clean":"2024-09-19T05:38:25.966456+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:38:25.966456+0000","last_undegraded":"2024-09-19T05:38:25.966456+0000","last_fullsized":"2024-09-19T05:38:25.966456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963574+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:38:25.963574+0000","last_peered":"2024-09-19T05:38:25.963574+0000","last_clean":"2024-09-19T05:38:25.963574+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:38:25.963574+0000","last_undegraded":"2024-09-19T05:38:25.963574+0000","last_fullsized":"2024-09-19T05:38:25.963574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.696320+0000","last_change":"2024-09-19T05:38:26.696320+0000","last_active":"2024-09-19T05:38:26.696320+0000","last_peered":"2024-09-19T05:38:26.696320+0000","last_clean":"2024-09-19T05:38:26.696320+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:38:26.696320+0000","last_undegraded":"2024-09-19T05:38:26.696320+0000","last_fullsized":"2024-09-19T05:38:26.696320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:33.249021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963663+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:38:25.963663+0000","last_peered":"2024-09-19T05:38:25.963663+0000","last_clean":"2024-09-19T05:38:25.963663+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:38:25.963663+0000","last_undegraded":"2024-09-19T05:38:25.963663+0000","last_fullsized":"2024-09-19T05:38:25.963663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.669165+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:38:26.669165+0000","last_peered":"2024-09-19T05:38:26.669165+0000","last_clean":"2024-09-19T05:38:26.669165+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:38:26.669165+0000","last_undegraded":"2024-09-19T05:38:26.669165+0000","last_fullsized":"2024-09-19T05:38:26.669165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694943+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:38:26.694943+0000","last_peered":"2024-09-19T05:38:26.694943+0000","last_clean":"2024-09-19T05:38:26.694943+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:38:26.694943+0000","last_undegraded":"2024-09-19T05:38:26.694943+0000","last_fullsized":"2024-09-19T05:38:26.694943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363217+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:38:26.363217+0000","last_peered":"2024-09-19T05:38:26.363217+0000","last_clean":"2024-09-19T05:38:26.363217+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:38:26.363217+0000","last_undegraded":"2024-09-19T05:38:26.363217+0000","last_fullsized":"2024-09-19T05:38:26.363217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963734+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:38:25.963734+0000","last_peered":"2024-09-19T05:38:25.963734+0000","last_clean":"2024-09-19T05:38:25.963734+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:38:25.963734+0000","last_undegraded":"2024-09-19T05:38:25.963734+0000","last_fullsized":"2024-09-19T05:38:25.963734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963179+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:38:25.963179+0000","last_peered":"2024-09-19T05:38:25.963179+0000","last_clean":"2024-09-19T05:38:25.963179+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:38:25.963179+0000","last_undegraded":"2024-09-19T05:38:25.963179+0000","last_fullsized":"2024-09-19T05:38:25.963179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964634+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:38:25.964634+0000","last_peered":"2024-09-19T05:38:25.964634+0000","last_clean":"2024-09-19T05:38:25.964634+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:38:25.964634+0000","last_undegraded":"2024-09-19T05:38:25.964634+0000","last_fullsized":"2024-09-19T05:38:25.964634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954269+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:38:28.954269+0000","last_peered":"2024-09-19T05:38:28.954269+0000","last_clean":"2024-09-19T05:38:28.954269+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:38:28.954269+0000","last_undegraded":"2024-09-19T05:38:28.954269+0000","last_fullsized":"2024-09-19T05:38:28.954269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963636+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:38:25.963636+0000","last_peered":"2024-09-19T05:38:25.963636+0000","last_clean":"2024-09-19T05:38:25.963636+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:38:25.963636+0000","last_undegraded":"2024-09-19T05:38:25.963636+0000","last_fullsized":"2024-09-19T05:38:25.963636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963143+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:38:25.963143+0000","last_peered":"2024-09-19T05:38:25.963143+0000","last_clean":"2024-09-19T05:38:25.963143+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:38:25.963143+0000","last_undegraded":"2024-09-19T05:38:25.963143+0000","last_fullsized":"2024-09-19T05:38:25.963143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965261+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:38:25.965261+0000","last_peered":"2024-09-19T05:38:25.965261+0000","last_clean":"2024-09-19T05:38:25.965261+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:38:25.965261+0000","last_undegraded":"2024-09-19T05:38:25.965261+0000","last_fullsized":"2024-09-19T05:38:25.965261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963760+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:38:25.963760+0000","last_peered":"2024-09-19T05:38:25.963760+0000","last_clean":"2024-09-19T05:38:25.963760+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:38:25.963760+0000","last_undegraded":"2024-09-19T05:38:25.963760+0000","last_fullsized":"2024-09-19T05:38:25.963760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694831+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:38:26.694831+0000","last_peered":"2024-09-19T05:38:26.694831+0000","last_clean":"2024-09-19T05:38:26.694831+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:38:26.694831+0000","last_undegraded":"2024-09-19T05:38:26.694831+0000","last_fullsized":"2024-09-19T05:38:26.694831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668657+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:38:26.668657+0000","last_peered":"2024-09-19T05:38:26.668657+0000","last_clean":"2024-09-19T05:38:26.668657+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:38:26.668657+0000","last_undegraded":"2024-09-19T05:38:26.668657+0000","last_fullsized":"2024-09-19T05:38:26.668657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695264+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:38:26.695264+0000","last_peered":"2024-09-19T05:38:26.695264+0000","last_clean":"2024-09-19T05:38:26.695264+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:38:26.695264+0000","last_undegraded":"2024-09-19T05:38:26.695264+0000","last_fullsized":"2024-09-19T05:38:26.695264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964757+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:38:25.964757+0000","last_peered":"2024-09-19T05:38:25.964757+0000","last_clean":"2024-09-19T05:38:25.964757+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:38:25.964757+0000","last_undegraded":"2024-09-19T05:38:25.964757+0000","last_fullsized":"2024-09-19T05:38:25.964757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362969+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:26.362969+0000","last_peered":"2024-09-19T05:38:26.362969+0000","last_clean":"2024-09-19T05:38:26.362969+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:26.362969+0000","last_undegraded":"2024-09-19T05:38:26.362969+0000","last_fullsized":"2024-09-19T05:38:26.362969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668668+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:38:26.668668+0000","last_peered":"2024-09-19T05:38:26.668668+0000","last_clean":"2024-09-19T05:38:26.668668+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:38:26.668668+0000","last_undegraded":"2024-09-19T05:38:26.668668+0000","last_fullsized":"2024-09-19T05:38:26.668668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963569+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:38:25.963569+0000","last_peered":"2024-09-19T05:38:25.963569+0000","last_clean":"2024-09-19T05:38:25.963569+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:38:25.963569+0000","last_undegraded":"2024-09-19T05:38:25.963569+0000","last_fullsized":"2024-09-19T05:38:25.963569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668886+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:38:26.668886+0000","last_peered":"2024-09-19T05:38:26.668886+0000","last_clean":"2024-09-19T05:38:26.668886+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:38:26.668886+0000","last_undegraded":"2024-09-19T05:38:26.668886+0000","last_fullsized":"2024-09-19T05:38:26.668886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965333+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:38:25.965333+0000","last_peered":"2024-09-19T05:38:25.965333+0000","last_clean":"2024-09-19T05:38:25.965333+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:38:25.965333+0000","last_undegraded":"2024-09-19T05:38:25.965333+0000","last_fullsized":"2024-09-19T05:38:25.965333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.696465+0000","last_change":"2024-09-19T05:38:26.696465+0000","last_active":"2024-09-19T05:38:26.696465+0000","last_peered":"2024-09-19T05:38:26.696465+0000","last_clean":"2024-09-19T05:38:26.696465+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:38:26.696465+0000","last_undegraded":"2024-09-19T05:38:26.696465+0000","last_fullsized":"2024-09-19T05:38:26.696465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:04.587288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363216+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:38:26.363216+0000","last_peered":"2024-09-19T05:38:26.363216+0000","last_clean":"2024-09-19T05:38:26.363216+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:38:26.363216+0000","last_undegraded":"2024-09-19T05:38:26.363216+0000","last_fullsized":"2024-09-19T05:38:26.363216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963958+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:38:25.963958+0000","last_peered":"2024-09-19T05:38:25.963958+0000","last_clean":"2024-09-19T05:38:25.963958+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:38:25.963958+0000","last_undegraded":"2024-09-19T05:38:25.963958+0000","last_fullsized":"2024-09-19T05:38:25.963958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695170+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:38:26.695170+0000","last_peered":"2024-09-19T05:38:26.695170+0000","last_clean":"2024-09-19T05:38:26.695170+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:38:26.695170+0000","last_undegraded":"2024-09-19T05:38:26.695170+0000","last_fullsized":"2024-09-19T05:38:26.695170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668900+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:38:26.668900+0000","last_peered":"2024-09-19T05:38:26.668900+0000","last_clean":"2024-09-19T05:38:26.668900+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:38:26.668900+0000","last_undegraded":"2024-09-19T05:38:26.668900+0000","last_fullsized":"2024-09-19T05:38:26.668900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.951357+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:38:28.951357+0000","last_peered":"2024-09-19T05:38:28.951357+0000","last_clean":"2024-09-19T05:38:28.951357+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:38:28.951357+0000","last_undegraded":"2024-09-19T05:38:28.951357+0000","last_fullsized":"2024-09-19T05:38:28.951357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362293+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:38:26.362293+0000","last_peered":"2024-09-19T05:38:26.362293+0000","last_clean":"2024-09-19T05:38:26.362293+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:38:26.362293+0000","last_undegraded":"2024-09-19T05:38:26.362293+0000","last_fullsized":"2024-09-19T05:38:26.362293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668822+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:38:26.668822+0000","last_peered":"2024-09-19T05:38:26.668822+0000","last_clean":"2024-09-19T05:38:26.668822+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:38:26.668822+0000","last_undegraded":"2024-09-19T05:38:26.668822+0000","last_fullsized":"2024-09-19T05:38:26.668822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964779+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:38:25.964779+0000","last_peered":"2024-09-19T05:38:25.964779+0000","last_clean":"2024-09-19T05:38:25.964779+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:38:25.964779+0000","last_undegraded":"2024-09-19T05:38:25.964779+0000","last_fullsized":"2024-09-19T05:38:25.964779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963994+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:38:25.963994+0000","last_peered":"2024-09-19T05:38:25.963994+0000","last_clean":"2024-09-19T05:38:25.963994+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:38:25.963994+0000","last_undegraded":"2024-09-19T05:38:25.963994+0000","last_fullsized":"2024-09-19T05:38:25.963994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668264+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:38:26.668264+0000","last_peered":"2024-09-19T05:38:26.668264+0000","last_clean":"2024-09-19T05:38:26.668264+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:38:26.668264+0000","last_undegraded":"2024-09-19T05:38:26.668264+0000","last_fullsized":"2024-09-19T05:38:26.668264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964592+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:38:25.964592+0000","last_peered":"2024-09-19T05:38:25.964592+0000","last_clean":"2024-09-19T05:38:25.964592+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:38:25.964592+0000","last_undegraded":"2024-09-19T05:38:25.964592+0000","last_fullsized":"2024-09-19T05:38:25.964592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695240+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:38:26.695240+0000","last_peered":"2024-09-19T05:38:26.695240+0000","last_clean":"2024-09-19T05:38:26.695240+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:38:26.695240+0000","last_undegraded":"2024-09-19T05:38:26.695240+0000","last_fullsized":"2024-09-19T05:38:26.695240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963593+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:38:25.963593+0000","last_peered":"2024-09-19T05:38:25.963593+0000","last_clean":"2024-09-19T05:38:25.963593+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:38:25.963593+0000","last_undegraded":"2024-09-19T05:38:25.963593+0000","last_fullsized":"2024-09-19T05:38:25.963593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963828+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:38:25.963828+0000","last_peered":"2024-09-19T05:38:25.963828+0000","last_clean":"2024-09-19T05:38:25.963828+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:38:25.963828+0000","last_undegraded":"2024-09-19T05:38:25.963828+0000","last_fullsized":"2024-09-19T05:38:25.963828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966291+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:38:25.966291+0000","last_peered":"2024-09-19T05:38:25.966291+0000","last_clean":"2024-09-19T05:38:25.966291+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:38:25.966291+0000","last_undegraded":"2024-09-19T05:38:25.966291+0000","last_fullsized":"2024-09-19T05:38:25.966291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668685+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:38:26.668685+0000","last_peered":"2024-09-19T05:38:26.668685+0000","last_clean":"2024-09-19T05:38:26.668685+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:38:26.668685+0000","last_undegraded":"2024-09-19T05:38:26.668685+0000","last_fullsized":"2024-09-19T05:38:26.668685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362999+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:38:26.362999+0000","last_peered":"2024-09-19T05:38:26.362999+0000","last_clean":"2024-09-19T05:38:26.362999+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:38:26.362999+0000","last_undegraded":"2024-09-19T05:38:26.362999+0000","last_fullsized":"2024-09-19T05:38:26.362999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965524+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:38:25.965524+0000","last_peered":"2024-09-19T05:38:25.965524+0000","last_clean":"2024-09-19T05:38:25.965524+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:38:25.965524+0000","last_undegraded":"2024-09-19T05:38:25.965524+0000","last_fullsized":"2024-09-19T05:38:25.965524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695073+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:38:26.695073+0000","last_peered":"2024-09-19T05:38:26.695073+0000","last_clean":"2024-09-19T05:38:26.695073+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:38:26.695073+0000","last_undegraded":"2024-09-19T05:38:26.695073+0000","last_fullsized":"2024-09-19T05:38:26.695073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955371+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:38:28.955371+0000","last_peered":"2024-09-19T05:38:28.955371+0000","last_clean":"2024-09-19T05:38:28.955371+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:38:28.955371+0000","last_undegraded":"2024-09-19T05:38:28.955371+0000","last_fullsized":"2024-09-19T05:38:28.955371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363053+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:38:26.363053+0000","last_peered":"2024-09-19T05:38:26.363053+0000","last_clean":"2024-09-19T05:38:26.363053+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:38:26.363053+0000","last_undegraded":"2024-09-19T05:38:26.363053+0000","last_fullsized":"2024-09-19T05:38:26.363053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668818+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:38:26.668818+0000","last_peered":"2024-09-19T05:38:26.668818+0000","last_clean":"2024-09-19T05:38:26.668818+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:38:26.668818+0000","last_undegraded":"2024-09-19T05:38:26.668818+0000","last_fullsized":"2024-09-19T05:38:26.668818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'15","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:36.315975+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:38:36.315975+0000","last_peered":"2024-09-19T05:38:36.315975+0000","last_clean":"2024-09-19T05:38:36.315975+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:38:36.315975+0000","last_undegraded":"2024-09-19T05:38:36.315975+0000","last_fullsized":"2024-09-19T05:38:36.315975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4287,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963280+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:38:25.963280+0000","last_peered":"2024-09-19T05:38:25.963280+0000","last_clean":"2024-09-19T05:38:25.963280+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:38:25.963280+0000","last_undegraded":"2024-09-19T05:38:25.963280+0000","last_fullsized":"2024-09-19T05:38:25.963280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964867+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:38:25.964867+0000","last_peered":"2024-09-19T05:38:25.964867+0000","last_clean":"2024-09-19T05:38:25.964867+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:38:25.964867+0000","last_undegraded":"2024-09-19T05:38:25.964867+0000","last_fullsized":"2024-09-19T05:38:25.964867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963881+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:38:25.963881+0000","last_peered":"2024-09-19T05:38:25.963881+0000","last_clean":"2024-09-19T05:38:25.963881+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:38:25.963881+0000","last_undegraded":"2024-09-19T05:38:25.963881+0000","last_fullsized":"2024-09-19T05:38:25.963881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964348+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:38:25.964348+0000","last_peered":"2024-09-19T05:38:25.964348+0000","last_clean":"2024-09-19T05:38:25.964348+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:38:25.964348+0000","last_undegraded":"2024-09-19T05:38:25.964348+0000","last_fullsized":"2024-09-19T05:38:25.964348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695343+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:38:26.695343+0000","last_peered":"2024-09-19T05:38:26.695343+0000","last_clean":"2024-09-19T05:38:26.695343+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:38:26.695343+0000","last_undegraded":"2024-09-19T05:38:26.695343+0000","last_fullsized":"2024-09-19T05:38:26.695343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954198+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:28.954198+0000","last_peered":"2024-09-19T05:38:28.954198+0000","last_clean":"2024-09-19T05:38:28.954198+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:28.954198+0000","last_undegraded":"2024-09-19T05:38:28.954198+0000","last_fullsized":"2024-09-19T05:38:28.954198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965083+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:38:25.965083+0000","last_peered":"2024-09-19T05:38:25.965083+0000","last_clean":"2024-09-19T05:38:25.965083+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:38:25.965083+0000","last_undegraded":"2024-09-19T05:38:25.965083+0000","last_fullsized":"2024-09-19T05:38:25.965083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.669788+0000","last_change":"2024-09-19T05:38:26.669788+0000","last_active":"2024-09-19T05:38:26.669788+0000","last_peered":"2024-09-19T05:38:26.669788+0000","last_clean":"2024-09-19T05:38:26.669788+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:38:26.669788+0000","last_undegraded":"2024-09-19T05:38:26.669788+0000","last_fullsized":"2024-09-19T05:38:26.669788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.207435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965834+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:38:25.965834+0000","last_peered":"2024-09-19T05:38:25.965834+0000","last_clean":"2024-09-19T05:38:25.965834+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:38:25.965834+0000","last_undegraded":"2024-09-19T05:38:25.965834+0000","last_fullsized":"2024-09-19T05:38:25.965834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965458+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:38:25.965458+0000","last_peered":"2024-09-19T05:38:25.965458+0000","last_clean":"2024-09-19T05:38:25.965458+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:38:25.965458+0000","last_undegraded":"2024-09-19T05:38:25.965458+0000","last_fullsized":"2024-09-19T05:38:25.965458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695160+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:38:26.695160+0000","last_peered":"2024-09-19T05:38:26.695160+0000","last_clean":"2024-09-19T05:38:26.695160+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:38:26.695160+0000","last_undegraded":"2024-09-19T05:38:26.695160+0000","last_fullsized":"2024-09-19T05:38:26.695160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.962977+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:38:25.962977+0000","last_peered":"2024-09-19T05:38:25.962977+0000","last_clean":"2024-09-19T05:38:25.962977+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:38:25.962977+0000","last_undegraded":"2024-09-19T05:38:25.962977+0000","last_fullsized":"2024-09-19T05:38:25.962977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362612+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:38:26.362612+0000","last_peered":"2024-09-19T05:38:26.362612+0000","last_clean":"2024-09-19T05:38:26.362612+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:38:26.362612+0000","last_undegraded":"2024-09-19T05:38:26.362612+0000","last_fullsized":"2024-09-19T05:38:26.362612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.696467+0000","last_change":"2024-09-19T05:38:26.696467+0000","last_active":"2024-09-19T05:38:26.696467+0000","last_peered":"2024-09-19T05:38:26.696467+0000","last_clean":"2024-09-19T05:38:26.696467+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:38:26.696467+0000","last_undegraded":"2024-09-19T05:38:26.696467+0000","last_fullsized":"2024-09-19T05:38:26.696467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:43.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965175+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:38:25.965175+0000","last_peered":"2024-09-19T05:38:25.965175+0000","last_clean":"2024-09-19T05:38:25.965175+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:38:25.965175+0000","last_undegraded":"2024-09-19T05:38:25.965175+0000","last_fullsized":"2024-09-19T05:38:25.965175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965802+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:38:25.965802+0000","last_peered":"2024-09-19T05:38:25.965802+0000","last_clean":"2024-09-19T05:38:25.965802+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:38:25.965802+0000","last_undegraded":"2024-09-19T05:38:25.965802+0000","last_fullsized":"2024-09-19T05:38:25.965802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965016+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:38:25.965016+0000","last_peered":"2024-09-19T05:38:25.965016+0000","last_clean":"2024-09-19T05:38:25.965016+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:38:25.965016+0000","last_undegraded":"2024-09-19T05:38:25.965016+0000","last_fullsized":"2024-09-19T05:38:25.965016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695179+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:38:26.695179+0000","last_peered":"2024-09-19T05:38:26.695179+0000","last_clean":"2024-09-19T05:38:26.695179+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:38:26.695179+0000","last_undegraded":"2024-09-19T05:38:26.695179+0000","last_fullsized":"2024-09-19T05:38:26.695179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965070+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:38:25.965070+0000","last_peered":"2024-09-19T05:38:25.965070+0000","last_clean":"2024-09-19T05:38:25.965070+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:38:25.965070+0000","last_undegraded":"2024-09-19T05:38:25.965070+0000","last_fullsized":"2024-09-19T05:38:25.965070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965737+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:38:25.965737+0000","last_peered":"2024-09-19T05:38:25.965737+0000","last_clean":"2024-09-19T05:38:25.965737+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:38:25.965737+0000","last_undegraded":"2024-09-19T05:38:25.965737+0000","last_fullsized":"2024-09-19T05:38:25.965737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964189+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:38:25.964189+0000","last_peered":"2024-09-19T05:38:25.964189+0000","last_clean":"2024-09-19T05:38:25.964189+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:38:25.964189+0000","last_undegraded":"2024-09-19T05:38:25.964189+0000","last_fullsized":"2024-09-19T05:38:25.964189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965114+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:38:25.965114+0000","last_peered":"2024-09-19T05:38:25.965114+0000","last_clean":"2024-09-19T05:38:25.965114+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:38:25.965114+0000","last_undegraded":"2024-09-19T05:38:25.965114+0000","last_fullsized":"2024-09-19T05:38:25.965114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963914+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:38:25.963914+0000","last_peered":"2024-09-19T05:38:25.963914+0000","last_clean":"2024-09-19T05:38:25.963914+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:38:25.963914+0000","last_undegraded":"2024-09-19T05:38:25.963914+0000","last_fullsized":"2024-09-19T05:38:25.963914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.967860+0000","last_change":"2024-09-19T05:38:25.967860+0000","last_active":"2024-09-19T05:38:25.967860+0000","last_peered":"2024-09-19T05:38:25.967860+0000","last_clean":"2024-09-19T05:38:25.967860+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:38:25.967860+0000","last_undegraded":"2024-09-19T05:38:25.967860+0000","last_fullsized":"2024-09-19T05:38:25.967860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:04.609599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362917+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:38:26.362917+0000","last_peered":"2024-09-19T05:38:26.362917+0000","last_clean":"2024-09-19T05:38:26.362917+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:38:26.362917+0000","last_undegraded":"2024-09-19T05:38:26.362917+0000","last_fullsized":"2024-09-19T05:38:26.362917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695092+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:38:26.695092+0000","last_peered":"2024-09-19T05:38:26.695092+0000","last_clean":"2024-09-19T05:38:26.695092+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:38:26.695092+0000","last_undegraded":"2024-09-19T05:38:26.695092+0000","last_fullsized":"2024-09-19T05:38:26.695092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.967776+0000","last_change":"2024-09-19T05:38:25.967776+0000","last_active":"2024-09-19T05:38:25.967776+0000","last_peered":"2024-09-19T05:38:25.967776+0000","last_clean":"2024-09-19T05:38:25.967776+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:38:25.967776+0000","last_undegraded":"2024-09-19T05:38:25.967776+0000","last_fullsized":"2024-09-19T05:38:25.967776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:43.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963796+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:38:25.963796+0000","last_peered":"2024-09-19T05:38:25.963796+0000","last_clean":"2024-09-19T05:38:25.963796+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:38:25.963796+0000","last_undegraded":"2024-09-19T05:38:25.963796+0000","last_fullsized":"2024-09-19T05:38:25.963796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965503+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:38:25.965503+0000","last_peered":"2024-09-19T05:38:25.965503+0000","last_clean":"2024-09-19T05:38:25.965503+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:38:25.965503+0000","last_undegraded":"2024-09-19T05:38:25.965503+0000","last_fullsized":"2024-09-19T05:38:25.965503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966377+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:38:25.966377+0000","last_peered":"2024-09-19T05:38:25.966377+0000","last_clean":"2024-09-19T05:38:25.966377+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:38:25.966377+0000","last_undegraded":"2024-09-19T05:38:25.966377+0000","last_fullsized":"2024-09-19T05:38:25.966377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362441+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:38:26.362441+0000","last_peered":"2024-09-19T05:38:26.362441+0000","last_clean":"2024-09-19T05:38:26.362441+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:38:26.362441+0000","last_undegraded":"2024-09-19T05:38:26.362441+0000","last_fullsized":"2024-09-19T05:38:26.362441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965608+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:38:25.965608+0000","last_peered":"2024-09-19T05:38:25.965608+0000","last_clean":"2024-09-19T05:38:25.965608+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:38:25.965608+0000","last_undegraded":"2024-09-19T05:38:25.965608+0000","last_fullsized":"2024-09-19T05:38:25.965608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362683+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:38:26.362683+0000","last_peered":"2024-09-19T05:38:26.362683+0000","last_clean":"2024-09-19T05:38:26.362683+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:38:26.362683+0000","last_undegraded":"2024-09-19T05:38:26.362683+0000","last_fullsized":"2024-09-19T05:38:26.362683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694959+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:38:26.694959+0000","last_peered":"2024-09-19T05:38:26.694959+0000","last_clean":"2024-09-19T05:38:26.694959+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:38:26.694959+0000","last_undegraded":"2024-09-19T05:38:26.694959+0000","last_fullsized":"2024-09-19T05:38:26.694959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963943+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:38:25.963943+0000","last_peered":"2024-09-19T05:38:25.963943+0000","last_clean":"2024-09-19T05:38:25.963943+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:38:25.963943+0000","last_undegraded":"2024-09-19T05:38:25.963943+0000","last_fullsized":"2024-09-19T05:38:25.963943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.669097+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:38:26.669097+0000","last_peered":"2024-09-19T05:38:26.669097+0000","last_clean":"2024-09-19T05:38:26.669097+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:38:26.669097+0000","last_undegraded":"2024-09-19T05:38:26.669097+0000","last_fullsized":"2024-09-19T05:38:26.669097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965420+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:38:25.965420+0000","last_peered":"2024-09-19T05:38:25.965420+0000","last_clean":"2024-09-19T05:38:25.965420+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:38:25.965420+0000","last_undegraded":"2024-09-19T05:38:25.965420+0000","last_fullsized":"2024-09-19T05:38:25.965420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363453+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:38:26.363453+0000","last_peered":"2024-09-19T05:38:26.363453+0000","last_clean":"2024-09-19T05:38:26.363453+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:38:26.363453+0000","last_undegraded":"2024-09-19T05:38:26.363453+0000","last_fullsized":"2024-09-19T05:38:26.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362738+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:38:26.362738+0000","last_peered":"2024-09-19T05:38:26.362738+0000","last_clean":"2024-09-19T05:38:26.362738+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:38:26.362738+0000","last_undegraded":"2024-09-19T05:38:26.362738+0000","last_fullsized":"2024-09-19T05:38:26.362738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963083+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:38:25.963083+0000","last_peered":"2024-09-19T05:38:25.963083+0000","last_clean":"2024-09-19T05:38:25.963083+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:38:25.963083+0000","last_undegraded":"2024-09-19T05:38:25.963083+0000","last_fullsized":"2024-09-19T05:38:25.963083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695020+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:38:26.695020+0000","last_peered":"2024-09-19T05:38:26.695020+0000","last_clean":"2024-09-19T05:38:26.695020+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:38:26.695020+0000","last_undegraded":"2024-09-19T05:38:26.695020+0000","last_fullsized":"2024-09-19T05:38:26.695020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965509+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:38:25.965509+0000","last_peered":"2024-09-19T05:38:25.965509+0000","last_clean":"2024-09-19T05:38:25.965509+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:38:25.965509+0000","last_undegraded":"2024-09-19T05:38:25.965509+0000","last_fullsized":"2024-09-19T05:38:25.965509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964737+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:38:25.964737+0000","last_peered":"2024-09-19T05:38:25.964737+0000","last_clean":"2024-09-19T05:38:25.964737+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:38:25.964737+0000","last_undegraded":"2024-09-19T05:38:25.964737+0000","last_fullsized":"2024-09-19T05:38:25.964737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.968706+0000","last_change":"2024-09-19T05:38:25.968706+0000","last_active":"2024-09-19T05:38:25.968706+0000","last_peered":"2024-09-19T05:38:25.968706+0000","last_clean":"2024-09-19T05:38:25.968706+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:38:25.968706+0000","last_undegraded":"2024-09-19T05:38:25.968706+0000","last_fullsized":"2024-09-19T05:38:25.968706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:52.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965493+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:38:25.965493+0000","last_peered":"2024-09-19T05:38:25.965493+0000","last_clean":"2024-09-19T05:38:25.965493+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:38:25.965493+0000","last_undegraded":"2024-09-19T05:38:25.965493+0000","last_fullsized":"2024-09-19T05:38:25.965493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668794+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:38:26.668794+0000","last_peered":"2024-09-19T05:38:26.668794+0000","last_clean":"2024-09-19T05:38:26.668794+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:38:26.668794+0000","last_undegraded":"2024-09-19T05:38:26.668794+0000","last_fullsized":"2024-09-19T05:38:26.668794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964986+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:38:25.964986+0000","last_peered":"2024-09-19T05:38:25.964986+0000","last_clean":"2024-09-19T05:38:25.964986+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:38:25.964986+0000","last_undegraded":"2024-09-19T05:38:25.964986+0000","last_fullsized":"2024-09-19T05:38:25.964986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668261+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:38:26.668261+0000","last_peered":"2024-09-19T05:38:26.668261+0000","last_clean":"2024-09-19T05:38:26.668261+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:38:26.668261+0000","last_undegraded":"2024-09-19T05:38:26.668261+0000","last_fullsized":"2024-09-19T05:38:26.668261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362605+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:38:26.362605+0000","last_peered":"2024-09-19T05:38:26.362605+0000","last_clean":"2024-09-19T05:38:26.362605+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:38:26.362605+0000","last_undegraded":"2024-09-19T05:38:26.362605+0000","last_fullsized":"2024-09-19T05:38:26.362605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668275+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:38:26.668275+0000","last_peered":"2024-09-19T05:38:26.668275+0000","last_clean":"2024-09-19T05:38:26.668275+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:38:26.668275+0000","last_undegraded":"2024-09-19T05:38:26.668275+0000","last_fullsized":"2024-09-19T05:38:26.668275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363026+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:38:26.363026+0000","last_peered":"2024-09-19T05:38:26.363026+0000","last_clean":"2024-09-19T05:38:26.363026+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:38:26.363026+0000","last_undegraded":"2024-09-19T05:38:26.363026+0000","last_fullsized":"2024-09-19T05:38:26.363026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695431+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:38:26.695431+0000","last_peered":"2024-09-19T05:38:26.695431+0000","last_clean":"2024-09-19T05:38:26.695431+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:38:26.695431+0000","last_undegraded":"2024-09-19T05:38:26.695431+0000","last_fullsized":"2024-09-19T05:38:26.695431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963494+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:38:25.963494+0000","last_peered":"2024-09-19T05:38:25.963494+0000","last_clean":"2024-09-19T05:38:25.963494+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:38:25.963494+0000","last_undegraded":"2024-09-19T05:38:25.963494+0000","last_fullsized":"2024-09-19T05:38:25.963494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668550+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:38:26.668550+0000","last_peered":"2024-09-19T05:38:26.668550+0000","last_clean":"2024-09-19T05:38:26.668550+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:38:26.668550+0000","last_undegraded":"2024-09-19T05:38:26.668550+0000","last_fullsized":"2024-09-19T05:38:26.668550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":11595,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":23633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718544,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":131153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":130301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":127095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:38.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:38:38.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.639+0000 7fbef041e640 1 Processor -- start 2024-09-19T05:38:38.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.639+0000 7fbef041e640 1 -- start start 2024-09-19T05:38:38.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbef041e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbee80cab90 0x7fbee815c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbef041e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee8074350 con 0x7fbee815c780 2024-09-19T05:38:38.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbef041e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee8074610 con 0x7fbee8152f00 2024-09-19T05:38:38.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbef041e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbee80c8cc0 con 0x7fbee80cab90 2024-09-19T05:38:38.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeee9bb640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbee815c780 0x7fbee80ce6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40826/0 (socket says 172.21.15.103:40826) 2024-09-19T05:38:38.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeee9bb640 1 -- 172.21.15.103:0/874333848 learned_addr learned my addr 172.21.15.103:0/874333848 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:38.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed9b9640 1 --2- 172.21.15.103:0/874333848 >> v2:172.21.15.174:3300/0 conn(0x7fbee80cab90 0x7fbee815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed1b8640 1 -- 172.21.15.103:0/874333848 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976359258 0 0) 0x7fbee8074350 con 0x7fbee815c780 2024-09-19T05:38:38.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed1b8640 1 -- 172.21.15.103:0/874333848 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbed4003520 con 0x7fbee815c780 2024-09-19T05:38:38.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed1b8640 1 -- 172.21.15.103:0/874333848 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158970791 0 0) 0x7fbee8074610 con 0x7fbee8152f00 2024-09-19T05:38:38.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed1b8640 1 -- 172.21.15.103:0/874333848 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbee8074350 con 0x7fbee8152f00 2024-09-19T05:38:38.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed9b9640 1 -- 172.21.15.103:0/874333848 >> v1:172.21.15.174:6789/0 conn(0x7fbee8152f00 legacy=0x7fbee8073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed9b9640 1 -- 172.21.15.103:0/874333848 >> v1:172.21.15.103:6789/0 conn(0x7fbee815c780 legacy=0x7fbee80ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.640+0000 7fbeed9b9640 1 -- 172.21.15.103:0/874333848 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee80c7f00 con 0x7fbee80cab90 2024-09-19T05:38:38.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.641+0000 7fbeed9b9640 1 --2- 172.21.15.103:0/874333848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee815c240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed80097a0 tx=0x7fbed802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa53757e71426df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.641+0000 7fbeed1b8640 1 -- 172.21.15.103:0/874333848 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8037070 con 0x7fbee80cab90 2024-09-19T05:38:38.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.641+0000 7fbeed1b8640 1 -- 172.21.15.103:0/874333848 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed8032440 con 0x7fbee80cab90 2024-09-19T05:38:38.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.641+0000 7fbeed1b8640 1 -- 172.21.15.103:0/874333848 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80327f0 con 0x7fbee80cab90 2024-09-19T05:38:38.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.642+0000 7fbef041e640 1 -- 172.21.15.103:0/874333848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 msgr2=0x7fbee815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.642+0000 7fbef041e640 1 --2- 172.21.15.103:0/874333848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee815c240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed80097a0 tx=0x7fbed802a230 comp rx=0 tx=0).stop 2024-09-19T05:38:38.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.642+0000 7fbef041e640 1 -- 172.21.15.103:0/874333848 shutdown_connections 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.642+0000 7fbef041e640 1 --2- 172.21.15.103:0/874333848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee815c240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.642+0000 7fbef041e640 1 -- 172.21.15.103:0/874333848 >> 172.21.15.103:0/874333848 conn(0x7fbee806c240 msgr2=0x7fbee8067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.642+0000 7fbef041e640 1 -- 172.21.15.103:0/874333848 shutdown_connections 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.642+0000 7fbef041e640 1 -- 172.21.15.103:0/874333848 wait complete. 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.643+0000 7fbef041e640 1 Processor -- start 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.643+0000 7fbef041e640 1 -- start start 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee80c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbee8152f00 0x7fbee815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee815c780 0x7fbee80c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbee80c87a0 con 0x7fbee815c780 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbee80c84c0 con 0x7fbee80cab90 2024-09-19T05:38:38.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbee8073710 con 0x7fbee8152f00 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee815c780 0x7fbee80c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee815c780 0x7fbee80c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57248/0 (socket says 172.21.15.103:57248) 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 -- 172.21.15.103:0/1523375517 learned_addr learned my addr 172.21.15.103:0/1523375517 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee1ba640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee80c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeed9b9640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbee8152f00 0x7fbee815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 -- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbee8152f00 msgr2=0x7fbee815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbee8152f00 0x7fbee815af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 -- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 msgr2=0x7fbee80c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee80c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 -- 172.21.15.103:0/1523375517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee81551a0 con 0x7fbee815c780 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee1ba640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee80c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbeee9bb640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee815c780 0x7fbee80c4560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbee000cb10 tx=0x7fbee000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbedeffd640 1 -- 172.21.15.103:0/1523375517 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0017070 con 0x7fbee815c780 2024-09-19T05:38:38.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbedeffd640 1 -- 172.21.15.103:0/1523375517 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee000ac70 con 0x7fbee815c780 2024-09-19T05:38:38.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee8155480 con 0x7fbee815c780 2024-09-19T05:38:38.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbedeffd640 1 -- 172.21.15.103:0/1523375517 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0012600 con 0x7fbee815c780 2024-09-19T05:38:38.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.644+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee80c4040 con 0x7fbee815c780 2024-09-19T05:38:38.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.645+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee81532e0 con 0x7fbee815c780 2024-09-19T05:38:38.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.646+0000 7fbedeffd640 1 -- 172.21.15.103:0/1523375517 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbee001a070 con 0x7fbee815c780 2024-09-19T05:38:38.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.646+0000 7fbedeffd640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbecc06c2b0 0x7fbecc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.646+0000 7fbeee1ba640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbecc06c2b0 0x7fbecc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.646+0000 7fbedeffd640 1 -- 172.21.15.103:0/1523375517 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbee008b590 con 0x7fbee815c780 2024-09-19T05:38:38.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.647+0000 7fbeee1ba640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbecc06c2b0 0x7fbecc06e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbee40011e0 tx=0x7fbee4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.650+0000 7fbedeffd640 1 -- 172.21.15.103:0/1523375517 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbee000ae20 con 0x7fbee815c780 2024-09-19T05:38:38.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.813+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbee80c3b30 con 0x7fbecc06c2b0 2024-09-19T05:38:38.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.821+0000 7fbedeffd640 1 -- 172.21.15.103:0/1523375517 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332747 (secure 0 0 0) 0x7fbee80c3b30 con 0x7fbecc06c2b0 2024-09-19T05:38:38.826 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:38.828 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbecc06c2b0 msgr2=0x7fbecc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbecc06c2b0 0x7fbecc06e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbee40011e0 tx=0x7fbee4009040 comp rx=0 tx=0).stop 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee815c780 msgr2=0x7fbee80c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee815c780 0x7fbee80c4560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbee000cb10 tx=0x7fbee000a060 comp rx=0 tx=0).stop 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 shutdown_connections 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbecc06c2b0 0x7fbecc06e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee815c780 0x7fbee80c4560 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbee8152f00 0x7fbee815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 --2- 172.21.15.103:0/1523375517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbee80cab90 0x7fbee80c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 >> 172.21.15.103:0/1523375517 conn(0x7fbee806c240 msgr2=0x7fbee8150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 shutdown_connections 2024-09-19T05:38:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.824+0000 7fbef041e640 1 -- 172.21.15.103:0/1523375517 wait complete. 2024-09-19T05:38:38.837 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-19T05:38:38.189580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":601963,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":372,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218912,"kb_used_data":2720,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755808,"statfs":{"total":773094113280,"available":772869947392,"internally_reserved":0,"allocated":2785280,"data_stored":2208547,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3519,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003022"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955633+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:38:28.955633+0000","last_peered":"2024-09-19T05:38:28.955633+0000","last_clean":"2024-09-19T05:38:28.955633+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:38:28.955633+0000","last_undegraded":"2024-09-19T05:38:28.955633+0000","last_fullsized":"2024-09-19T05:38:28.955633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965981+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:38:25.965981+0000","last_peered":"2024-09-19T05:38:25.965981+0000","last_clean":"2024-09-19T05:38:25.965981+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:38:25.965981+0000","last_undegraded":"2024-09-19T05:38:25.965981+0000","last_fullsized":"2024-09-19T05:38:25.965981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965347+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:38:25.965347+0000","last_peered":"2024-09-19T05:38:25.965347+0000","last_clean":"2024-09-19T05:38:25.965347+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:38:25.965347+0000","last_undegraded":"2024-09-19T05:38:25.965347+0000","last_fullsized":"2024-09-19T05:38:25.965347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966558+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:38:25.966558+0000","last_peered":"2024-09-19T05:38:25.966558+0000","last_clean":"2024-09-19T05:38:25.966558+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:38:25.966558+0000","last_undegraded":"2024-09-19T05:38:25.966558+0000","last_fullsized":"2024-09-19T05:38:25.966558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695184+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:38:26.695184+0000","last_peered":"2024-09-19T05:38:26.695184+0000","last_clean":"2024-09-19T05:38:26.695184+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:38:26.695184+0000","last_undegraded":"2024-09-19T05:38:26.695184+0000","last_fullsized":"2024-09-19T05:38:26.695184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963813+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:38:25.963813+0000","last_peered":"2024-09-19T05:38:25.963813+0000","last_clean":"2024-09-19T05:38:25.963813+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:38:25.963813+0000","last_undegraded":"2024-09-19T05:38:25.963813+0000","last_fullsized":"2024-09-19T05:38:25.963813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'12","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958252+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:38:28.958252+0000","last_peered":"2024-09-19T05:38:28.958252+0000","last_clean":"2024-09-19T05:38:28.958252+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:38:28.958252+0000","last_undegraded":"2024-09-19T05:38:28.958252+0000","last_fullsized":"2024-09-19T05:38:28.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363172+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:38:26.363172+0000","last_peered":"2024-09-19T05:38:26.363172+0000","last_clean":"2024-09-19T05:38:26.363172+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:38:26.363172+0000","last_undegraded":"2024-09-19T05:38:26.363172+0000","last_fullsized":"2024-09-19T05:38:26.363172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964151+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:38:25.964151+0000","last_peered":"2024-09-19T05:38:25.964151+0000","last_clean":"2024-09-19T05:38:25.964151+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:38:25.964151+0000","last_undegraded":"2024-09-19T05:38:25.964151+0000","last_fullsized":"2024-09-19T05:38:25.964151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955838+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:38:28.955838+0000","last_peered":"2024-09-19T05:38:28.955838+0000","last_clean":"2024-09-19T05:38:28.955838+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:38:28.955838+0000","last_undegraded":"2024-09-19T05:38:28.955838+0000","last_fullsized":"2024-09-19T05:38:28.955838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363062+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:38:26.363062+0000","last_peered":"2024-09-19T05:38:26.363062+0000","last_clean":"2024-09-19T05:38:26.363062+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:38:26.363062+0000","last_undegraded":"2024-09-19T05:38:26.363062+0000","last_fullsized":"2024-09-19T05:38:26.363062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963721+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:38:25.963721+0000","last_peered":"2024-09-19T05:38:25.963721+0000","last_clean":"2024-09-19T05:38:25.963721+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:38:25.963721+0000","last_undegraded":"2024-09-19T05:38:25.963721+0000","last_fullsized":"2024-09-19T05:38:25.963721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964871+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:38:25.964871+0000","last_peered":"2024-09-19T05:38:25.964871+0000","last_clean":"2024-09-19T05:38:25.964871+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:38:25.964871+0000","last_undegraded":"2024-09-19T05:38:25.964871+0000","last_fullsized":"2024-09-19T05:38:25.964871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668498+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:38:26.668498+0000","last_peered":"2024-09-19T05:38:26.668498+0000","last_clean":"2024-09-19T05:38:26.668498+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:38:26.668498+0000","last_undegraded":"2024-09-19T05:38:26.668498+0000","last_fullsized":"2024-09-19T05:38:26.668498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964520+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:38:25.964520+0000","last_peered":"2024-09-19T05:38:25.964520+0000","last_clean":"2024-09-19T05:38:25.964520+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:38:25.964520+0000","last_undegraded":"2024-09-19T05:38:25.964520+0000","last_fullsized":"2024-09-19T05:38:25.964520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965600+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:38:25.965600+0000","last_peered":"2024-09-19T05:38:25.965600+0000","last_clean":"2024-09-19T05:38:25.965600+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:38:25.965600+0000","last_undegraded":"2024-09-19T05:38:25.965600+0000","last_fullsized":"2024-09-19T05:38:25.965600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963768+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:38:25.963768+0000","last_peered":"2024-09-19T05:38:25.963768+0000","last_clean":"2024-09-19T05:38:25.963768+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:38:25.963768+0000","last_undegraded":"2024-09-19T05:38:25.963768+0000","last_fullsized":"2024-09-19T05:38:25.963768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964494+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:38:25.964494+0000","last_peered":"2024-09-19T05:38:25.964494+0000","last_clean":"2024-09-19T05:38:25.964494+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:38:25.964494+0000","last_undegraded":"2024-09-19T05:38:25.964494+0000","last_fullsized":"2024-09-19T05:38:25.964494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965262+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:38:25.965262+0000","last_peered":"2024-09-19T05:38:25.965262+0000","last_clean":"2024-09-19T05:38:25.965262+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:38:25.965262+0000","last_undegraded":"2024-09-19T05:38:25.965262+0000","last_fullsized":"2024-09-19T05:38:25.965262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954395+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:38:28.954395+0000","last_peered":"2024-09-19T05:38:28.954395+0000","last_clean":"2024-09-19T05:38:28.954395+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:38:28.954395+0000","last_undegraded":"2024-09-19T05:38:28.954395+0000","last_fullsized":"2024-09-19T05:38:28.954395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963532+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:38:25.963532+0000","last_peered":"2024-09-19T05:38:25.963532+0000","last_clean":"2024-09-19T05:38:25.963532+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:38:25.963532+0000","last_undegraded":"2024-09-19T05:38:25.963532+0000","last_fullsized":"2024-09-19T05:38:25.963532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964706+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:38:25.964706+0000","last_peered":"2024-09-19T05:38:25.964706+0000","last_clean":"2024-09-19T05:38:25.964706+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:38:25.964706+0000","last_undegraded":"2024-09-19T05:38:25.964706+0000","last_fullsized":"2024-09-19T05:38:25.964706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668515+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:26.668515+0000","last_peered":"2024-09-19T05:38:26.668515+0000","last_clean":"2024-09-19T05:38:26.668515+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:26.668515+0000","last_undegraded":"2024-09-19T05:38:26.668515+0000","last_fullsized":"2024-09-19T05:38:26.668515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964657+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:38:25.964657+0000","last_peered":"2024-09-19T05:38:25.964657+0000","last_clean":"2024-09-19T05:38:25.964657+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:38:25.964657+0000","last_undegraded":"2024-09-19T05:38:25.964657+0000","last_fullsized":"2024-09-19T05:38:25.964657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695405+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:38:26.695405+0000","last_peered":"2024-09-19T05:38:26.695405+0000","last_clean":"2024-09-19T05:38:26.695405+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:38:26.695405+0000","last_undegraded":"2024-09-19T05:38:26.695405+0000","last_fullsized":"2024-09-19T05:38:26.695405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954488+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:38:28.954488+0000","last_peered":"2024-09-19T05:38:28.954488+0000","last_clean":"2024-09-19T05:38:28.954488+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:38:28.954488+0000","last_undegraded":"2024-09-19T05:38:28.954488+0000","last_fullsized":"2024-09-19T05:38:28.954488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964312+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:38:25.964312+0000","last_peered":"2024-09-19T05:38:25.964312+0000","last_clean":"2024-09-19T05:38:25.964312+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:38:25.964312+0000","last_undegraded":"2024-09-19T05:38:25.964312+0000","last_fullsized":"2024-09-19T05:38:25.964312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966456+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:38:25.966456+0000","last_peered":"2024-09-19T05:38:25.966456+0000","last_clean":"2024-09-19T05:38:25.966456+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:38:25.966456+0000","last_undegraded":"2024-09-19T05:38:25.966456+0000","last_fullsized":"2024-09-19T05:38:25.966456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963574+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:38:25.963574+0000","last_peered":"2024-09-19T05:38:25.963574+0000","last_clean":"2024-09-19T05:38:25.963574+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:38:25.963574+0000","last_undegraded":"2024-09-19T05:38:25.963574+0000","last_fullsized":"2024-09-19T05:38:25.963574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.696320+0000","last_change":"2024-09-19T05:38:26.696320+0000","last_active":"2024-09-19T05:38:26.696320+0000","last_peered":"2024-09-19T05:38:26.696320+0000","last_clean":"2024-09-19T05:38:26.696320+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:38:26.696320+0000","last_undegraded":"2024-09-19T05:38:26.696320+0000","last_fullsized":"2024-09-19T05:38:26.696320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:33.249021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963663+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:38:25.963663+0000","last_peered":"2024-09-19T05:38:25.963663+0000","last_clean":"2024-09-19T05:38:25.963663+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:38:25.963663+0000","last_undegraded":"2024-09-19T05:38:25.963663+0000","last_fullsized":"2024-09-19T05:38:25.963663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.669165+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:38:26.669165+0000","last_peered":"2024-09-19T05:38:26.669165+0000","last_clean":"2024-09-19T05:38:26.669165+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:38:26.669165+0000","last_undegraded":"2024-09-19T05:38:26.669165+0000","last_fullsized":"2024-09-19T05:38:26.669165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694943+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:38:26.694943+0000","last_peered":"2024-09-19T05:38:26.694943+0000","last_clean":"2024-09-19T05:38:26.694943+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:38:26.694943+0000","last_undegraded":"2024-09-19T05:38:26.694943+0000","last_fullsized":"2024-09-19T05:38:26.694943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363217+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:38:26.363217+0000","last_peered":"2024-09-19T05:38:26.363217+0000","last_clean":"2024-09-19T05:38:26.363217+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:38:26.363217+0000","last_undegraded":"2024-09-19T05:38:26.363217+0000","last_fullsized":"2024-09-19T05:38:26.363217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963734+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:38:25.963734+0000","last_peered":"2024-09-19T05:38:25.963734+0000","last_clean":"2024-09-19T05:38:25.963734+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:38:25.963734+0000","last_undegraded":"2024-09-19T05:38:25.963734+0000","last_fullsized":"2024-09-19T05:38:25.963734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963179+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:38:25.963179+0000","last_peered":"2024-09-19T05:38:25.963179+0000","last_clean":"2024-09-19T05:38:25.963179+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:38:25.963179+0000","last_undegraded":"2024-09-19T05:38:25.963179+0000","last_fullsized":"2024-09-19T05:38:25.963179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964634+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:38:25.964634+0000","last_peered":"2024-09-19T05:38:25.964634+0000","last_clean":"2024-09-19T05:38:25.964634+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:38:25.964634+0000","last_undegraded":"2024-09-19T05:38:25.964634+0000","last_fullsized":"2024-09-19T05:38:25.964634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954269+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:38:28.954269+0000","last_peered":"2024-09-19T05:38:28.954269+0000","last_clean":"2024-09-19T05:38:28.954269+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:38:28.954269+0000","last_undegraded":"2024-09-19T05:38:28.954269+0000","last_fullsized":"2024-09-19T05:38:28.954269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963636+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:38:25.963636+0000","last_peered":"2024-09-19T05:38:25.963636+0000","last_clean":"2024-09-19T05:38:25.963636+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:38:25.963636+0000","last_undegraded":"2024-09-19T05:38:25.963636+0000","last_fullsized":"2024-09-19T05:38:25.963636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963143+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:38:25.963143+0000","last_peered":"2024-09-19T05:38:25.963143+0000","last_clean":"2024-09-19T05:38:25.963143+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:38:25.963143+0000","last_undegraded":"2024-09-19T05:38:25.963143+0000","last_fullsized":"2024-09-19T05:38:25.963143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965261+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:38:25.965261+0000","last_peered":"2024-09-19T05:38:25.965261+0000","last_clean":"2024-09-19T05:38:25.965261+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:38:25.965261+0000","last_undegraded":"2024-09-19T05:38:25.965261+0000","last_fullsized":"2024-09-19T05:38:25.965261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963760+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:38:25.963760+0000","last_peered":"2024-09-19T05:38:25.963760+0000","last_clean":"2024-09-19T05:38:25.963760+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:38:25.963760+0000","last_undegraded":"2024-09-19T05:38:25.963760+0000","last_fullsized":"2024-09-19T05:38:25.963760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694831+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:38:26.694831+0000","last_peered":"2024-09-19T05:38:26.694831+0000","last_clean":"2024-09-19T05:38:26.694831+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:38:26.694831+0000","last_undegraded":"2024-09-19T05:38:26.694831+0000","last_fullsized":"2024-09-19T05:38:26.694831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668657+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:38:26.668657+0000","last_peered":"2024-09-19T05:38:26.668657+0000","last_clean":"2024-09-19T05:38:26.668657+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:38:26.668657+0000","last_undegraded":"2024-09-19T05:38:26.668657+0000","last_fullsized":"2024-09-19T05:38:26.668657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695264+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:38:26.695264+0000","last_peered":"2024-09-19T05:38:26.695264+0000","last_clean":"2024-09-19T05:38:26.695264+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:38:26.695264+0000","last_undegraded":"2024-09-19T05:38:26.695264+0000","last_fullsized":"2024-09-19T05:38:26.695264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964757+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:38:25.964757+0000","last_peered":"2024-09-19T05:38:25.964757+0000","last_clean":"2024-09-19T05:38:25.964757+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:38:25.964757+0000","last_undegraded":"2024-09-19T05:38:25.964757+0000","last_fullsized":"2024-09-19T05:38:25.964757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362969+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:26.362969+0000","last_peered":"2024-09-19T05:38:26.362969+0000","last_clean":"2024-09-19T05:38:26.362969+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:26.362969+0000","last_undegraded":"2024-09-19T05:38:26.362969+0000","last_fullsized":"2024-09-19T05:38:26.362969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668668+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:38:26.668668+0000","last_peered":"2024-09-19T05:38:26.668668+0000","last_clean":"2024-09-19T05:38:26.668668+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:38:26.668668+0000","last_undegraded":"2024-09-19T05:38:26.668668+0000","last_fullsized":"2024-09-19T05:38:26.668668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963569+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:38:25.963569+0000","last_peered":"2024-09-19T05:38:25.963569+0000","last_clean":"2024-09-19T05:38:25.963569+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:38:25.963569+0000","last_undegraded":"2024-09-19T05:38:25.963569+0000","last_fullsized":"2024-09-19T05:38:25.963569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668886+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:38:26.668886+0000","last_peered":"2024-09-19T05:38:26.668886+0000","last_clean":"2024-09-19T05:38:26.668886+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:38:26.668886+0000","last_undegraded":"2024-09-19T05:38:26.668886+0000","last_fullsized":"2024-09-19T05:38:26.668886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965333+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:38:25.965333+0000","last_peered":"2024-09-19T05:38:25.965333+0000","last_clean":"2024-09-19T05:38:25.965333+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:38:25.965333+0000","last_undegraded":"2024-09-19T05:38:25.965333+0000","last_fullsized":"2024-09-19T05:38:25.965333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.696465+0000","last_change":"2024-09-19T05:38:26.696465+0000","last_active":"2024-09-19T05:38:26.696465+0000","last_peered":"2024-09-19T05:38:26.696465+0000","last_clean":"2024-09-19T05:38:26.696465+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:38:26.696465+0000","last_undegraded":"2024-09-19T05:38:26.696465+0000","last_fullsized":"2024-09-19T05:38:26.696465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:04.587288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363216+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:38:26.363216+0000","last_peered":"2024-09-19T05:38:26.363216+0000","last_clean":"2024-09-19T05:38:26.363216+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:38:26.363216+0000","last_undegraded":"2024-09-19T05:38:26.363216+0000","last_fullsized":"2024-09-19T05:38:26.363216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963958+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:38:25.963958+0000","last_peered":"2024-09-19T05:38:25.963958+0000","last_clean":"2024-09-19T05:38:25.963958+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:38:25.963958+0000","last_undegraded":"2024-09-19T05:38:25.963958+0000","last_fullsized":"2024-09-19T05:38:25.963958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695170+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:38:26.695170+0000","last_peered":"2024-09-19T05:38:26.695170+0000","last_clean":"2024-09-19T05:38:26.695170+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:38:26.695170+0000","last_undegraded":"2024-09-19T05:38:26.695170+0000","last_fullsized":"2024-09-19T05:38:26.695170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668900+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:38:26.668900+0000","last_peered":"2024-09-19T05:38:26.668900+0000","last_clean":"2024-09-19T05:38:26.668900+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:38:26.668900+0000","last_undegraded":"2024-09-19T05:38:26.668900+0000","last_fullsized":"2024-09-19T05:38:26.668900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.951357+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:38:28.951357+0000","last_peered":"2024-09-19T05:38:28.951357+0000","last_clean":"2024-09-19T05:38:28.951357+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:38:28.951357+0000","last_undegraded":"2024-09-19T05:38:28.951357+0000","last_fullsized":"2024-09-19T05:38:28.951357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362293+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:38:26.362293+0000","last_peered":"2024-09-19T05:38:26.362293+0000","last_clean":"2024-09-19T05:38:26.362293+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:38:26.362293+0000","last_undegraded":"2024-09-19T05:38:26.362293+0000","last_fullsized":"2024-09-19T05:38:26.362293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668822+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:38:26.668822+0000","last_peered":"2024-09-19T05:38:26.668822+0000","last_clean":"2024-09-19T05:38:26.668822+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:38:26.668822+0000","last_undegraded":"2024-09-19T05:38:26.668822+0000","last_fullsized":"2024-09-19T05:38:26.668822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964779+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:38:25.964779+0000","last_peered":"2024-09-19T05:38:25.964779+0000","last_clean":"2024-09-19T05:38:25.964779+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:38:25.964779+0000","last_undegraded":"2024-09-19T05:38:25.964779+0000","last_fullsized":"2024-09-19T05:38:25.964779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963994+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:38:25.963994+0000","last_peered":"2024-09-19T05:38:25.963994+0000","last_clean":"2024-09-19T05:38:25.963994+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:38:25.963994+0000","last_undegraded":"2024-09-19T05:38:25.963994+0000","last_fullsized":"2024-09-19T05:38:25.963994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668264+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:38:26.668264+0000","last_peered":"2024-09-19T05:38:26.668264+0000","last_clean":"2024-09-19T05:38:26.668264+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:38:26.668264+0000","last_undegraded":"2024-09-19T05:38:26.668264+0000","last_fullsized":"2024-09-19T05:38:26.668264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964592+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:38:25.964592+0000","last_peered":"2024-09-19T05:38:25.964592+0000","last_clean":"2024-09-19T05:38:25.964592+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:38:25.964592+0000","last_undegraded":"2024-09-19T05:38:25.964592+0000","last_fullsized":"2024-09-19T05:38:25.964592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695240+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:38:26.695240+0000","last_peered":"2024-09-19T05:38:26.695240+0000","last_clean":"2024-09-19T05:38:26.695240+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:38:26.695240+0000","last_undegraded":"2024-09-19T05:38:26.695240+0000","last_fullsized":"2024-09-19T05:38:26.695240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963593+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:38:25.963593+0000","last_peered":"2024-09-19T05:38:25.963593+0000","last_clean":"2024-09-19T05:38:25.963593+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:38:25.963593+0000","last_undegraded":"2024-09-19T05:38:25.963593+0000","last_fullsized":"2024-09-19T05:38:25.963593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963828+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:38:25.963828+0000","last_peered":"2024-09-19T05:38:25.963828+0000","last_clean":"2024-09-19T05:38:25.963828+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:38:25.963828+0000","last_undegraded":"2024-09-19T05:38:25.963828+0000","last_fullsized":"2024-09-19T05:38:25.963828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966291+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:38:25.966291+0000","last_peered":"2024-09-19T05:38:25.966291+0000","last_clean":"2024-09-19T05:38:25.966291+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:38:25.966291+0000","last_undegraded":"2024-09-19T05:38:25.966291+0000","last_fullsized":"2024-09-19T05:38:25.966291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668685+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:38:26.668685+0000","last_peered":"2024-09-19T05:38:26.668685+0000","last_clean":"2024-09-19T05:38:26.668685+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:38:26.668685+0000","last_undegraded":"2024-09-19T05:38:26.668685+0000","last_fullsized":"2024-09-19T05:38:26.668685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362999+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:38:26.362999+0000","last_peered":"2024-09-19T05:38:26.362999+0000","last_clean":"2024-09-19T05:38:26.362999+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:38:26.362999+0000","last_undegraded":"2024-09-19T05:38:26.362999+0000","last_fullsized":"2024-09-19T05:38:26.362999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965524+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:38:25.965524+0000","last_peered":"2024-09-19T05:38:25.965524+0000","last_clean":"2024-09-19T05:38:25.965524+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:38:25.965524+0000","last_undegraded":"2024-09-19T05:38:25.965524+0000","last_fullsized":"2024-09-19T05:38:25.965524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695073+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:38:26.695073+0000","last_peered":"2024-09-19T05:38:26.695073+0000","last_clean":"2024-09-19T05:38:26.695073+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:38:26.695073+0000","last_undegraded":"2024-09-19T05:38:26.695073+0000","last_fullsized":"2024-09-19T05:38:26.695073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955371+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:38:28.955371+0000","last_peered":"2024-09-19T05:38:28.955371+0000","last_clean":"2024-09-19T05:38:28.955371+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:38:28.955371+0000","last_undegraded":"2024-09-19T05:38:28.955371+0000","last_fullsized":"2024-09-19T05:38:28.955371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363053+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:38:26.363053+0000","last_peered":"2024-09-19T05:38:26.363053+0000","last_clean":"2024-09-19T05:38:26.363053+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:38:26.363053+0000","last_undegraded":"2024-09-19T05:38:26.363053+0000","last_fullsized":"2024-09-19T05:38:26.363053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668818+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:38:26.668818+0000","last_peered":"2024-09-19T05:38:26.668818+0000","last_clean":"2024-09-19T05:38:26.668818+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:38:26.668818+0000","last_undegraded":"2024-09-19T05:38:26.668818+0000","last_fullsized":"2024-09-19T05:38:26.668818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'15","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:36.315975+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:38:36.315975+0000","last_peered":"2024-09-19T05:38:36.315975+0000","last_clean":"2024-09-19T05:38:36.315975+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:38:36.315975+0000","last_undegraded":"2024-09-19T05:38:36.315975+0000","last_fullsized":"2024-09-19T05:38:36.315975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4287,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963280+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:38:25.963280+0000","last_peered":"2024-09-19T05:38:25.963280+0000","last_clean":"2024-09-19T05:38:25.963280+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:38:25.963280+0000","last_undegraded":"2024-09-19T05:38:25.963280+0000","last_fullsized":"2024-09-19T05:38:25.963280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964867+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:38:25.964867+0000","last_peered":"2024-09-19T05:38:25.964867+0000","last_clean":"2024-09-19T05:38:25.964867+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:38:25.964867+0000","last_undegraded":"2024-09-19T05:38:25.964867+0000","last_fullsized":"2024-09-19T05:38:25.964867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963881+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:38:25.963881+0000","last_peered":"2024-09-19T05:38:25.963881+0000","last_clean":"2024-09-19T05:38:25.963881+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:38:25.963881+0000","last_undegraded":"2024-09-19T05:38:25.963881+0000","last_fullsized":"2024-09-19T05:38:25.963881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964348+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:38:25.964348+0000","last_peered":"2024-09-19T05:38:25.964348+0000","last_clean":"2024-09-19T05:38:25.964348+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:38:25.964348+0000","last_undegraded":"2024-09-19T05:38:25.964348+0000","last_fullsized":"2024-09-19T05:38:25.964348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695343+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:38:26.695343+0000","last_peered":"2024-09-19T05:38:26.695343+0000","last_clean":"2024-09-19T05:38:26.695343+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:38:26.695343+0000","last_undegraded":"2024-09-19T05:38:26.695343+0000","last_fullsized":"2024-09-19T05:38:26.695343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954198+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:28.954198+0000","last_peered":"2024-09-19T05:38:28.954198+0000","last_clean":"2024-09-19T05:38:28.954198+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:28.954198+0000","last_undegraded":"2024-09-19T05:38:28.954198+0000","last_fullsized":"2024-09-19T05:38:28.954198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965083+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:38:25.965083+0000","last_peered":"2024-09-19T05:38:25.965083+0000","last_clean":"2024-09-19T05:38:25.965083+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:38:25.965083+0000","last_undegraded":"2024-09-19T05:38:25.965083+0000","last_fullsized":"2024-09-19T05:38:25.965083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.669788+0000","last_change":"2024-09-19T05:38:26.669788+0000","last_active":"2024-09-19T05:38:26.669788+0000","last_peered":"2024-09-19T05:38:26.669788+0000","last_clean":"2024-09-19T05:38:26.669788+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:38:26.669788+0000","last_undegraded":"2024-09-19T05:38:26.669788+0000","last_fullsized":"2024-09-19T05:38:26.669788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.207435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965834+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:38:25.965834+0000","last_peered":"2024-09-19T05:38:25.965834+0000","last_clean":"2024-09-19T05:38:25.965834+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:38:25.965834+0000","last_undegraded":"2024-09-19T05:38:25.965834+0000","last_fullsized":"2024-09-19T05:38:25.965834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965458+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:38:25.965458+0000","last_peered":"2024-09-19T05:38:25.965458+0000","last_clean":"2024-09-19T05:38:25.965458+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:38:25.965458+0000","last_undegraded":"2024-09-19T05:38:25.965458+0000","last_fullsized":"2024-09-19T05:38:25.965458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695160+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:38:26.695160+0000","last_peered":"2024-09-19T05:38:26.695160+0000","last_clean":"2024-09-19T05:38:26.695160+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:38:26.695160+0000","last_undegraded":"2024-09-19T05:38:26.695160+0000","last_fullsized":"2024-09-19T05:38:26.695160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.962977+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:38:25.962977+0000","last_peered":"2024-09-19T05:38:25.962977+0000","last_clean":"2024-09-19T05:38:25.962977+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:38:25.962977+0000","last_undegraded":"2024-09-19T05:38:25.962977+0000","last_fullsized":"2024-09-19T05:38:25.962977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362612+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:38:26.362612+0000","last_peered":"2024-09-19T05:38:26.362612+0000","last_clean":"2024-09-19T05:38:26.362612+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:38:26.362612+0000","last_undegraded":"2024-09-19T05:38:26.362612+0000","last_fullsized":"2024-09-19T05:38:26.362612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.696467+0000","last_change":"2024-09-19T05:38:26.696467+0000","last_active":"2024-09-19T05:38:26.696467+0000","last_peered":"2024-09-19T05:38:26.696467+0000","last_clean":"2024-09-19T05:38:26.696467+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:38:26.696467+0000","last_undegraded":"2024-09-19T05:38:26.696467+0000","last_fullsized":"2024-09-19T05:38:26.696467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:43.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965175+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:38:25.965175+0000","last_peered":"2024-09-19T05:38:25.965175+0000","last_clean":"2024-09-19T05:38:25.965175+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:38:25.965175+0000","last_undegraded":"2024-09-19T05:38:25.965175+0000","last_fullsized":"2024-09-19T05:38:25.965175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965802+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:38:25.965802+0000","last_peered":"2024-09-19T05:38:25.965802+0000","last_clean":"2024-09-19T05:38:25.965802+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:38:25.965802+0000","last_undegraded":"2024-09-19T05:38:25.965802+0000","last_fullsized":"2024-09-19T05:38:25.965802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965016+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:38:25.965016+0000","last_peered":"2024-09-19T05:38:25.965016+0000","last_clean":"2024-09-19T05:38:25.965016+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:38:25.965016+0000","last_undegraded":"2024-09-19T05:38:25.965016+0000","last_fullsized":"2024-09-19T05:38:25.965016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695179+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:38:26.695179+0000","last_peered":"2024-09-19T05:38:26.695179+0000","last_clean":"2024-09-19T05:38:26.695179+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:38:26.695179+0000","last_undegraded":"2024-09-19T05:38:26.695179+0000","last_fullsized":"2024-09-19T05:38:26.695179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965070+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:38:25.965070+0000","last_peered":"2024-09-19T05:38:25.965070+0000","last_clean":"2024-09-19T05:38:25.965070+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:38:25.965070+0000","last_undegraded":"2024-09-19T05:38:25.965070+0000","last_fullsized":"2024-09-19T05:38:25.965070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965737+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:38:25.965737+0000","last_peered":"2024-09-19T05:38:25.965737+0000","last_clean":"2024-09-19T05:38:25.965737+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:38:25.965737+0000","last_undegraded":"2024-09-19T05:38:25.965737+0000","last_fullsized":"2024-09-19T05:38:25.965737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964189+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:38:25.964189+0000","last_peered":"2024-09-19T05:38:25.964189+0000","last_clean":"2024-09-19T05:38:25.964189+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:38:25.964189+0000","last_undegraded":"2024-09-19T05:38:25.964189+0000","last_fullsized":"2024-09-19T05:38:25.964189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965114+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:38:25.965114+0000","last_peered":"2024-09-19T05:38:25.965114+0000","last_clean":"2024-09-19T05:38:25.965114+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:38:25.965114+0000","last_undegraded":"2024-09-19T05:38:25.965114+0000","last_fullsized":"2024-09-19T05:38:25.965114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963914+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:38:25.963914+0000","last_peered":"2024-09-19T05:38:25.963914+0000","last_clean":"2024-09-19T05:38:25.963914+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:38:25.963914+0000","last_undegraded":"2024-09-19T05:38:25.963914+0000","last_fullsized":"2024-09-19T05:38:25.963914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.967860+0000","last_change":"2024-09-19T05:38:25.967860+0000","last_active":"2024-09-19T05:38:25.967860+0000","last_peered":"2024-09-19T05:38:25.967860+0000","last_clean":"2024-09-19T05:38:25.967860+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:38:25.967860+0000","last_undegraded":"2024-09-19T05:38:25.967860+0000","last_fullsized":"2024-09-19T05:38:25.967860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:04.609599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362917+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:38:26.362917+0000","last_peered":"2024-09-19T05:38:26.362917+0000","last_clean":"2024-09-19T05:38:26.362917+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:38:26.362917+0000","last_undegraded":"2024-09-19T05:38:26.362917+0000","last_fullsized":"2024-09-19T05:38:26.362917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695092+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:38:26.695092+0000","last_peered":"2024-09-19T05:38:26.695092+0000","last_clean":"2024-09-19T05:38:26.695092+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:38:26.695092+0000","last_undegraded":"2024-09-19T05:38:26.695092+0000","last_fullsized":"2024-09-19T05:38:26.695092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.967776+0000","last_change":"2024-09-19T05:38:25.967776+0000","last_active":"2024-09-19T05:38:25.967776+0000","last_peered":"2024-09-19T05:38:25.967776+0000","last_clean":"2024-09-19T05:38:25.967776+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:38:25.967776+0000","last_undegraded":"2024-09-19T05:38:25.967776+0000","last_fullsized":"2024-09-19T05:38:25.967776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:43.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963796+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:38:25.963796+0000","last_peered":"2024-09-19T05:38:25.963796+0000","last_clean":"2024-09-19T05:38:25.963796+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:38:25.963796+0000","last_undegraded":"2024-09-19T05:38:25.963796+0000","last_fullsized":"2024-09-19T05:38:25.963796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965503+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:38:25.965503+0000","last_peered":"2024-09-19T05:38:25.965503+0000","last_clean":"2024-09-19T05:38:25.965503+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:38:25.965503+0000","last_undegraded":"2024-09-19T05:38:25.965503+0000","last_fullsized":"2024-09-19T05:38:25.965503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966377+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:38:25.966377+0000","last_peered":"2024-09-19T05:38:25.966377+0000","last_clean":"2024-09-19T05:38:25.966377+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:38:25.966377+0000","last_undegraded":"2024-09-19T05:38:25.966377+0000","last_fullsized":"2024-09-19T05:38:25.966377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362441+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:38:26.362441+0000","last_peered":"2024-09-19T05:38:26.362441+0000","last_clean":"2024-09-19T05:38:26.362441+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:38:26.362441+0000","last_undegraded":"2024-09-19T05:38:26.362441+0000","last_fullsized":"2024-09-19T05:38:26.362441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965608+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:38:25.965608+0000","last_peered":"2024-09-19T05:38:25.965608+0000","last_clean":"2024-09-19T05:38:25.965608+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:38:25.965608+0000","last_undegraded":"2024-09-19T05:38:25.965608+0000","last_fullsized":"2024-09-19T05:38:25.965608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362683+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:38:26.362683+0000","last_peered":"2024-09-19T05:38:26.362683+0000","last_clean":"2024-09-19T05:38:26.362683+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:38:26.362683+0000","last_undegraded":"2024-09-19T05:38:26.362683+0000","last_fullsized":"2024-09-19T05:38:26.362683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694959+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:38:26.694959+0000","last_peered":"2024-09-19T05:38:26.694959+0000","last_clean":"2024-09-19T05:38:26.694959+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:38:26.694959+0000","last_undegraded":"2024-09-19T05:38:26.694959+0000","last_fullsized":"2024-09-19T05:38:26.694959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963943+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:38:25.963943+0000","last_peered":"2024-09-19T05:38:25.963943+0000","last_clean":"2024-09-19T05:38:25.963943+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:38:25.963943+0000","last_undegraded":"2024-09-19T05:38:25.963943+0000","last_fullsized":"2024-09-19T05:38:25.963943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.669097+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:38:26.669097+0000","last_peered":"2024-09-19T05:38:26.669097+0000","last_clean":"2024-09-19T05:38:26.669097+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:38:26.669097+0000","last_undegraded":"2024-09-19T05:38:26.669097+0000","last_fullsized":"2024-09-19T05:38:26.669097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965420+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:38:25.965420+0000","last_peered":"2024-09-19T05:38:25.965420+0000","last_clean":"2024-09-19T05:38:25.965420+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:38:25.965420+0000","last_undegraded":"2024-09-19T05:38:25.965420+0000","last_fullsized":"2024-09-19T05:38:25.965420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363453+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:38:26.363453+0000","last_peered":"2024-09-19T05:38:26.363453+0000","last_clean":"2024-09-19T05:38:26.363453+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:38:26.363453+0000","last_undegraded":"2024-09-19T05:38:26.363453+0000","last_fullsized":"2024-09-19T05:38:26.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362738+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:38:26.362738+0000","last_peered":"2024-09-19T05:38:26.362738+0000","last_clean":"2024-09-19T05:38:26.362738+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:38:26.362738+0000","last_undegraded":"2024-09-19T05:38:26.362738+0000","last_fullsized":"2024-09-19T05:38:26.362738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963083+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:38:25.963083+0000","last_peered":"2024-09-19T05:38:25.963083+0000","last_clean":"2024-09-19T05:38:25.963083+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:38:25.963083+0000","last_undegraded":"2024-09-19T05:38:25.963083+0000","last_fullsized":"2024-09-19T05:38:25.963083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695020+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:38:26.695020+0000","last_peered":"2024-09-19T05:38:26.695020+0000","last_clean":"2024-09-19T05:38:26.695020+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:38:26.695020+0000","last_undegraded":"2024-09-19T05:38:26.695020+0000","last_fullsized":"2024-09-19T05:38:26.695020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965509+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:38:25.965509+0000","last_peered":"2024-09-19T05:38:25.965509+0000","last_clean":"2024-09-19T05:38:25.965509+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:38:25.965509+0000","last_undegraded":"2024-09-19T05:38:25.965509+0000","last_fullsized":"2024-09-19T05:38:25.965509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964737+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:38:25.964737+0000","last_peered":"2024-09-19T05:38:25.964737+0000","last_clean":"2024-09-19T05:38:25.964737+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:38:25.964737+0000","last_undegraded":"2024-09-19T05:38:25.964737+0000","last_fullsized":"2024-09-19T05:38:25.964737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.968706+0000","last_change":"2024-09-19T05:38:25.968706+0000","last_active":"2024-09-19T05:38:25.968706+0000","last_peered":"2024-09-19T05:38:25.968706+0000","last_clean":"2024-09-19T05:38:25.968706+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:38:25.968706+0000","last_undegraded":"2024-09-19T05:38:25.968706+0000","last_fullsized":"2024-09-19T05:38:25.968706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:52.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965493+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:38:25.965493+0000","last_peered":"2024-09-19T05:38:25.965493+0000","last_clean":"2024-09-19T05:38:25.965493+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:38:25.965493+0000","last_undegraded":"2024-09-19T05:38:25.965493+0000","last_fullsized":"2024-09-19T05:38:25.965493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668794+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:38:26.668794+0000","last_peered":"2024-09-19T05:38:26.668794+0000","last_clean":"2024-09-19T05:38:26.668794+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:38:26.668794+0000","last_undegraded":"2024-09-19T05:38:26.668794+0000","last_fullsized":"2024-09-19T05:38:26.668794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964986+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:38:25.964986+0000","last_peered":"2024-09-19T05:38:25.964986+0000","last_clean":"2024-09-19T05:38:25.964986+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:38:25.964986+0000","last_undegraded":"2024-09-19T05:38:25.964986+0000","last_fullsized":"2024-09-19T05:38:25.964986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668261+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:38:26.668261+0000","last_peered":"2024-09-19T05:38:26.668261+0000","last_clean":"2024-09-19T05:38:26.668261+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:38:26.668261+0000","last_undegraded":"2024-09-19T05:38:26.668261+0000","last_fullsized":"2024-09-19T05:38:26.668261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362605+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:38:26.362605+0000","last_peered":"2024-09-19T05:38:26.362605+0000","last_clean":"2024-09-19T05:38:26.362605+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:38:26.362605+0000","last_undegraded":"2024-09-19T05:38:26.362605+0000","last_fullsized":"2024-09-19T05:38:26.362605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668275+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:38:26.668275+0000","last_peered":"2024-09-19T05:38:26.668275+0000","last_clean":"2024-09-19T05:38:26.668275+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:38:26.668275+0000","last_undegraded":"2024-09-19T05:38:26.668275+0000","last_fullsized":"2024-09-19T05:38:26.668275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363026+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:38:26.363026+0000","last_peered":"2024-09-19T05:38:26.363026+0000","last_clean":"2024-09-19T05:38:26.363026+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:38:26.363026+0000","last_undegraded":"2024-09-19T05:38:26.363026+0000","last_fullsized":"2024-09-19T05:38:26.363026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695431+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:38:26.695431+0000","last_peered":"2024-09-19T05:38:26.695431+0000","last_clean":"2024-09-19T05:38:26.695431+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:38:26.695431+0000","last_undegraded":"2024-09-19T05:38:26.695431+0000","last_fullsized":"2024-09-19T05:38:26.695431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963494+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:38:25.963494+0000","last_peered":"2024-09-19T05:38:25.963494+0000","last_clean":"2024-09-19T05:38:25.963494+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:38:25.963494+0000","last_undegraded":"2024-09-19T05:38:25.963494+0000","last_fullsized":"2024-09-19T05:38:25.963494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668550+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:38:26.668550+0000","last_peered":"2024-09-19T05:38:26.668550+0000","last_clean":"2024-09-19T05:38:26.668550+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:38:26.668550+0000","last_undegraded":"2024-09-19T05:38:26.668550+0000","last_fullsized":"2024-09-19T05:38:26.668550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":11595,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":23633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718544,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":131153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":130301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":127095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:38:38.842 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-19T05:38:38.842 DEBUG:tasks.mon_thrash:Yielding 2024-09-19T05:38:38.843 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T05:38:38.856 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T05:38:38.856 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T05:38:38.856 INFO:tasks.workunit:timeout=3h 2024-09-19T05:38:38.856 INFO:tasks.workunit:cleanup=True 2024-09-19T05:38:38.856 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:38.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:38:38.893 INFO:teuthology.orchestra.run.smithi103.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-19 05:37:48.773309470 +0000 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-19 05:37:56.302756357 +0000 2024-09-19T05:38:38.894 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-19T05:38:38.894 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T05:38:38.894 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T05:38:38.966 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T05:38:38.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.976+0000 7fdb632e4640 1 Processor -- start 2024-09-19T05:38:38.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.976+0000 7fdb632e4640 1 -- start start 2024-09-19T05:38:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb632e4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb5c1550b0 0x7fdb5c073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb632e4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c06d730 0x7fdb5c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb632e4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb5c155490 0x7fdb5c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb632e4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5c15edb0 con 0x7fdb5c1550b0 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb632e4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5c0c9d00 con 0x7fdb5c155490 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb632e4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c15e4a0 con 0x7fdb5c06d730 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61080640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb5c1550b0 0x7fdb5c073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61080640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb5c1550b0 0x7fdb5c073f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57262/0 (socket says 172.21.15.103:57262) 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61080640 1 -- 172.21.15.103:0/123670486 learned_addr learned my addr 172.21.15.103:0/123670486 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61881640 1 --2- 172.21.15.103:0/123670486 >> v2:172.21.15.174:3300/0 conn(0x7fdb5c155490 0x7fdb5c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb6087f640 1 --2- 172.21.15.103:0/123670486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c06d730 0x7fdb5c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61080640 1 -- 172.21.15.103:0/123670486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c06d730 msgr2=0x7fdb5c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61080640 1 --2- 172.21.15.103:0/123670486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c06d730 0x7fdb5c0ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61080640 1 -- 172.21.15.103:0/123670486 >> v2:172.21.15.174:3300/0 conn(0x7fdb5c155490 msgr2=0x7fdb5c0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.977+0000 7fdb61080640 1 --2- 172.21.15.103:0/123670486 >> v2:172.21.15.174:3300/0 conn(0x7fdb5c155490 0x7fdb5c0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.978+0000 7fdb61080640 1 -- 172.21.15.103:0/123670486 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c0c9fc0 con 0x7fdb5c1550b0 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.978+0000 7fdb61881640 1 --2- 172.21.15.103:0/123670486 >> v2:172.21.15.174:3300/0 conn(0x7fdb5c155490 0x7fdb5c0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.978+0000 7fdb61080640 1 --2- 172.21.15.103:0/123670486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c1550b0 0x7fdb5c073f60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c068690 tx=0x7fdb4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5dcd5c9533f549b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.978+0000 7fdb5bfff640 1 -- 172.21.15.103:0/123670486 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c036070 con 0x7fdb5c1550b0 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.978+0000 7fdb5bfff640 1 -- 172.21.15.103:0/123670486 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c031600 con 0x7fdb5c1550b0 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.978+0000 7fdb5bfff640 1 -- 172.21.15.103:0/123670486 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0319d0 con 0x7fdb5c1550b0 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 -- 172.21.15.103:0/123670486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c1550b0 msgr2=0x7fdb5c073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 --2- 172.21.15.103:0/123670486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c1550b0 0x7fdb5c073f60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c068690 tx=0x7fdb4c02a730 comp rx=0 tx=0).stop 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 -- 172.21.15.103:0/123670486 shutdown_connections 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 --2- 172.21.15.103:0/123670486 >> v2:172.21.15.174:3300/0 conn(0x7fdb5c155490 0x7fdb5c0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 --2- 172.21.15.103:0/123670486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c06d730 0x7fdb5c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 --2- 172.21.15.103:0/123670486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c1550b0 0x7fdb5c073f60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 -- 172.21.15.103:0/123670486 >> 172.21.15.103:0/123670486 conn(0x7fdb5c06c240 msgr2=0x7fdb5c067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 -- 172.21.15.103:0/123670486 shutdown_connections 2024-09-19T05:38:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.979+0000 7fdb632e4640 1 -- 172.21.15.103:0/123670486 wait complete. 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.980+0000 7fdb632e4640 1 Processor -- start 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.980+0000 7fdb632e4640 1 -- start start 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb632e4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c1550b0 0x7fdb5c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb632e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c155490 0x7fdb5c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb632e4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c0c3060 0x7fdb5c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb632e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c15f240 con 0x7fdb5c155490 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb632e4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c15ea40 con 0x7fdb5c0c3060 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb632e4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c1f2370 con 0x7fdb5c1550b0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb6087f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c155490 0x7fdb5c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb6087f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c155490 0x7fdb5c155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57276/0 (socket says 172.21.15.103:57276) 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb6087f640 1 -- 172.21.15.103:0/1807261756 learned_addr learned my addr 172.21.15.103:0/1807261756 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb61881640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c0c3060 0x7fdb5c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.981+0000 7fdb61080640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c1550b0 0x7fdb5c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb6087f640 1 -- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c1550b0 msgr2=0x7fdb5c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb6087f640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c1550b0 0x7fdb5c0c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb6087f640 1 -- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c0c3060 msgr2=0x7fdb5c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb6087f640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c0c3060 0x7fdb5c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb6087f640 1 -- 172.21.15.103:0/1807261756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c156730 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb6087f640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c155490 0x7fdb5c155e30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c7f0 tx=0x7fdb5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb59ffb640 1 -- 172.21.15.103:0/1807261756 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50015070 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb59ffb640 1 -- 172.21.15.103:0/1807261756 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb50004220 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c1f15b0 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb59ffb640 1 -- 172.21.15.103:0/1807261756 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50007620 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.982+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c1f1b70 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.983+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c074520 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.983+0000 7fdb59ffb640 1 -- 172.21.15.103:0/1807261756 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdb500079d0 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.984+0000 7fdb59ffb640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb4806c2b0 0x7fdb4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.984+0000 7fdb59ffb640 1 -- 172.21.15.103:0/1807261756 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdb5008b830 con 0x7fdb5c155490 2024-09-19T05:38:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.984+0000 7fdb61080640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb4806c2b0 0x7fdb4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.984+0000 7fdb61080640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb4806c2b0 0x7fdb4806e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c033000 tx=0x7fdb4c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:38.989+0000 7fdb59ffb640 1 -- 172.21.15.103:0/1807261756 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdb50059550 con 0x7fdb5c155490 2024-09-19T05:38:38.995 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T05:38:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.202+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5c0ceac0 con 0x7fdb5c155490 2024-09-19T05:38:39.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.202+0000 7fdb59ffb640 1 -- 172.21.15.103:0/1807261756 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6965 (secure 0 0 0) 0x7fdb5005d850 con 0x7fdb5c155490 2024-09-19T05:38:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:38:39.205 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":18,"btime":"2024-09-19T05:38:28:967859+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:28.967854+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4241,4276,4302,4296,4299]},"id":1}]} 2024-09-19T05:38:39.205 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 18 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb4806c2b0 msgr2=0x7fdb4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb4806c2b0 0x7fdb4806e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c033000 tx=0x7fdb4c009000 comp rx=0 tx=0).stop 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c155490 msgr2=0x7fdb5c155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c155490 0x7fdb5c155e30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c7f0 tx=0x7fdb5000ccb0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 shutdown_connections 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb4806c2b0 0x7fdb4806e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c0c3060 0x7fdb5c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb5c155490 0x7fdb5c155e30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 --2- 172.21.15.103:0/1807261756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb5c1550b0 0x7fdb5c0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 >> 172.21.15.103:0/1807261756 conn(0x7fdb5c06c240 msgr2=0x7fdb5c14fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 shutdown_connections 2024-09-19T05:38:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.205+0000 7fdb632e4640 1 -- 172.21.15.103:0/1807261756 wait complete. 2024-09-19T05:38:39.219 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-19T05:38:39.219 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726724318, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-19T05:38:39.219 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T05:38:39.219 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:38:39.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.357+0000 7ff2c800e640 1 Processor -- start 2024-09-19T05:38:39.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.357+0000 7ff2c800e640 1 -- start start 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c800e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2c01530a0 0x7ff2c015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c800e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c015cbb0 0x7ff2c00c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c800e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c00c8a90 con 0x7ff2c0152cc0 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c800e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c00cf570 con 0x7ff2c01530a0 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c800e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c015d000 con 0x7ff2c015cbb0 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c65ab640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c015cbb0 0x7ff2c00c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c55a9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2c01530a0 0x7ff2c015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c65ab640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c015cbb0 0x7ff2c00c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:41776/0 (socket says 172.21.15.103:41776) 2024-09-19T05:38:39.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c55a9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2c01530a0 0x7ff2c015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:38142/0 (socket says 172.21.15.103:38142) 2024-09-19T05:38:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c5daa640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff2c0152cc0 0x7ff2c0071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:55866/0 (socket says 172.21.15.103:55866) 2024-09-19T05:38:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c65ab640 1 -- 172.21.15.103:0/838565828 learned_addr learned my addr 172.21.15.103:0/838565828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c65ab640 1 -- 172.21.15.103:0/838565828 >> v2:172.21.15.174:3300/0 conn(0x7ff2c01530a0 msgr2=0x7ff2c015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.358+0000 7ff2c65ab640 1 --2- 172.21.15.103:0/838565828 >> v2:172.21.15.174:3300/0 conn(0x7ff2c01530a0 0x7ff2c015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.359+0000 7ff2c65ab640 1 -- 172.21.15.103:0/838565828 >> v1:172.21.15.174:6789/0 conn(0x7ff2c0152cc0 legacy=0x7ff2c0071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.359+0000 7ff2c65ab640 1 -- 172.21.15.103:0/838565828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c00c7f10 con 0x7ff2c015cbb0 2024-09-19T05:38:39.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.359+0000 7ff2c55a9640 1 --2- 172.21.15.103:0/838565828 >> v2:172.21.15.174:3300/0 conn(0x7ff2c01530a0 0x7ff2c015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:39.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.359+0000 7ff2c65ab640 1 --2- 172.21.15.103:0/838565828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c015cbb0 0x7ff2c00c5ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009e50 tx=0x7ff2b802a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7baddc1bbb36ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.359+0000 7ff2c4da8640 1 -- 172.21.15.103:0/838565828 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8036070 con 0x7ff2c015cbb0 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.359+0000 7ff2c4da8640 1 -- 172.21.15.103:0/838565828 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b8031600 con 0x7ff2c015cbb0 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.359+0000 7ff2c4da8640 1 -- 172.21.15.103:0/838565828 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80319d0 con 0x7ff2c015cbb0 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 -- 172.21.15.103:0/838565828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c015cbb0 msgr2=0x7ff2c00c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 --2- 172.21.15.103:0/838565828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c015cbb0 0x7ff2c00c5ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009e50 tx=0x7ff2b802a7a0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 -- 172.21.15.103:0/838565828 shutdown_connections 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 --2- 172.21.15.103:0/838565828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c015cbb0 0x7ff2c00c5ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 --2- 172.21.15.103:0/838565828 >> v2:172.21.15.174:3300/0 conn(0x7ff2c01530a0 0x7ff2c015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 -- 172.21.15.103:0/838565828 >> 172.21.15.103:0/838565828 conn(0x7ff2c006f910 msgr2=0x7ff2c00735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 -- 172.21.15.103:0/838565828 shutdown_connections 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.360+0000 7ff2c800e640 1 -- 172.21.15.103:0/838565828 wait complete. 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.361+0000 7ff2c800e640 1 Processor -- start 2024-09-19T05:38:39.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.361+0000 7ff2c800e640 1 -- start start 2024-09-19T05:38:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c800e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c0152cc0 0x7ff2c01550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c800e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c01530a0 0x7ff2c01e35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c800e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2c015cbb0 0x7ff2c0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c800e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00c87b0 con 0x7ff2c0152cc0 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c800e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00c84d0 con 0x7ff2c015cbb0 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c800e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c015c150 con 0x7ff2c01530a0 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c0152cc0 0x7ff2c01550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c0152cc0 0x7ff2c01550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57288/0 (socket says 172.21.15.103:57288) 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 -- 172.21.15.103:0/805746253 learned_addr learned my addr 172.21.15.103:0/805746253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c65ab640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2c015cbb0 0x7ff2c0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c55a9640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c01530a0 0x7ff2c01e35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 -- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c01530a0 msgr2=0x7ff2c01e35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c01530a0 0x7ff2c01e35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 -- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2c015cbb0 msgr2=0x7ff2c0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2c015cbb0 0x7ff2c0159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 -- 172.21.15.103:0/805746253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c00c54a0 con 0x7ff2c0152cc0 2024-09-19T05:38:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c55a9640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c01530a0 0x7ff2c01e35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.362+0000 7ff2c5daa640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c0152cc0 0x7ff2c01550a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c400 tx=0x7ff2bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.363+0000 7ff2b67fc640 1 -- 172.21.15.103:0/805746253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0074e0 con 0x7ff2c0152cc0 2024-09-19T05:38:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.363+0000 7ff2b67fc640 1 -- 172.21.15.103:0/805746253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc007680 con 0x7ff2c0152cc0 2024-09-19T05:38:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.363+0000 7ff2b67fc640 1 -- 172.21.15.103:0/805746253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc004a00 con 0x7ff2c0152cc0 2024-09-19T05:38:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.363+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c01541a0 con 0x7ff2c0152cc0 2024-09-19T05:38:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.363+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c0155eb0 con 0x7ff2c0152cc0 2024-09-19T05:38:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.364+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c00cb120 con 0x7ff2c0152cc0 2024-09-19T05:38:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.365+0000 7ff2b67fc640 1 -- 172.21.15.103:0/805746253 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff2bc01a020 con 0x7ff2c0152cc0 2024-09-19T05:38:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.365+0000 7ff2b67fc640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff2a406c2e0 0x7ff2a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.365+0000 7ff2b67fc640 1 -- 172.21.15.103:0/805746253 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff2bc08b200 con 0x7ff2c0152cc0 2024-09-19T05:38:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.365+0000 7ff2c55a9640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff2a406c2e0 0x7ff2a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.365+0000 7ff2c55a9640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff2a406c2e0 0x7ff2a406e7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0145900 tx=0x7ff2b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.369+0000 7ff2b67fc640 1 -- 172.21.15.103:0/805746253 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff2c00cb120 con 0x7ff2c0152cc0 2024-09-19T05:38:39.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.621+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff2c00c7b90 con 0x7ff2c0152cc0 2024-09-19T05:38:39.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.622+0000 7ff2b67fc640 1 -- 172.21.15.103:0/805746253 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7ff2bc010300 con 0x7ff2c0152cc0 2024-09-19T05:38:39.625 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":79,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff2a406c2e0 msgr2=0x7ff2a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff2a406c2e0 0x7ff2a406e7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0145900 tx=0x7ff2b0008040 comp rx=0 tx=0).stop 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c0152cc0 msgr2=0x7ff2c01550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c0152cc0 0x7ff2c01550a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c400 tx=0x7ff2bc00c8c0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 shutdown_connections 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff2a406c2e0 0x7ff2a406e7a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2c015cbb0 0x7ff2c0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2c01530a0 0x7ff2c01e35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 --2- 172.21.15.103:0/805746253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c0152cc0 0x7ff2c01550a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 >> 172.21.15.103:0/805746253 conn(0x7ff2c006f910 msgr2=0x7ff2c0148f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 shutdown_connections 2024-09-19T05:38:39.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.624+0000 7ff2c800e640 1 -- 172.21.15.103:0/805746253 wait complete. 2024-09-19T05:38:39.638 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T05:38:39.638 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T05:38:39.638 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T05:38:39.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T05:38:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.737+0000 7fe934781640 1 Processor -- start 2024-09-19T05:38:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.737+0000 7fe934781640 1 -- start start 2024-09-19T05:38:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe934781640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe92c155040 0x7fe92c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe934781640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe934781640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92c0cbed0 con 0x7fe92c0b3540 2024-09-19T05:38:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe934781640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe92c15bd70 con 0x7fe92c155040 2024-09-19T05:38:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe934781640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c0cbbf0 con 0x7fe92c0c5950 2024-09-19T05:38:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe93251d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe92c155040 0x7fe92c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe931d1c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe92c0b3540 0x7fe92c15e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40838/0 (socket says 172.21.15.103:40838) 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe93251d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe92c155040 0x7fe92c0cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57302/0 (socket says 172.21.15.103:57302) 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe931d1c640 1 -- 172.21.15.103:0/4099697767 learned_addr learned my addr 172.21.15.103:0/4099697767 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe932d1e640 1 --2- 172.21.15.103:0/4099697767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe93251d640 1 -- 172.21.15.103:0/4099697767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 msgr2=0x7fe92c0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe93251d640 1 --2- 172.21.15.103:0/4099697767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c0cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe93251d640 1 -- 172.21.15.103:0/4099697767 >> v1:172.21.15.103:6789/0 conn(0x7fe92c0b3540 legacy=0x7fe92c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe93251d640 1 -- 172.21.15.103:0/4099697767 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c15afb0 con 0x7fe92c155040 2024-09-19T05:38:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.738+0000 7fe932d1e640 1 --2- 172.21.15.103:0/4099697767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.739+0000 7fe93251d640 1 --2- 172.21.15.103:0/4099697767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c155040 0x7fe92c0cb540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097a0 tx=0x7fe91c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98e984c3b2a4934 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.739+0000 7fe93151b640 1 -- 172.21.15.103:0/4099697767 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c037070 con 0x7fe92c155040 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.739+0000 7fe93151b640 1 -- 172.21.15.103:0/4099697767 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c032440 con 0x7fe92c155040 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.739+0000 7fe93151b640 1 -- 172.21.15.103:0/4099697767 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c032810 con 0x7fe92c155040 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 -- 172.21.15.103:0/4099697767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c155040 msgr2=0x7fe92c0cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 --2- 172.21.15.103:0/4099697767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c155040 0x7fe92c0cb540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0097a0 tx=0x7fe91c02a180 comp rx=0 tx=0).stop 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 -- 172.21.15.103:0/4099697767 shutdown_connections 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 --2- 172.21.15.103:0/4099697767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 --2- 172.21.15.103:0/4099697767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c155040 0x7fe92c0cb540 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 -- 172.21.15.103:0/4099697767 >> 172.21.15.103:0/4099697767 conn(0x7fe92c073340 msgr2=0x7fe92c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 -- 172.21.15.103:0/4099697767 shutdown_connections 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.740+0000 7fe934781640 1 -- 172.21.15.103:0/4099697767 wait complete. 2024-09-19T05:38:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.741+0000 7fe934781640 1 Processor -- start 2024-09-19T05:38:39.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.741+0000 7fe934781640 1 -- start start 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe934781640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0b3540 0x7fe92c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe934781640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c1e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe934781640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c155040 0x7fe92c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe934781640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c15b850 con 0x7fe92c0b3540 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe934781640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c15b570 con 0x7fe92c155040 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe934781640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c15eb30 con 0x7fe92c0c5950 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe93251d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0b3540 0x7fe92c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe93251d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0b3540 0x7fe92c14dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57316/0 (socket says 172.21.15.103:57316) 2024-09-19T05:38:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe93251d640 1 -- 172.21.15.103:0/2343872507 learned_addr learned my addr 172.21.15.103:0/2343872507 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe932d1e640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c155040 0x7fe92c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.742+0000 7fe931d1c640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c1e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe93251d640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 msgr2=0x7fe92c1e7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe93251d640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92c0c5950 0x7fe92c1e7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe93251d640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c155040 msgr2=0x7fe92c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe93251d640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c155040 0x7fe92c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe93251d640 1 -- 172.21.15.103:0/2343872507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c0cfdf0 con 0x7fe92c0b3540 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe932d1e640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c155040 0x7fe92c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe93251d640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0b3540 0x7fe92c14dee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe91c035040 tx=0x7fe91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c037040 con 0x7fe92c0b3540 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c030770 con 0x7fe92c0b3540 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c0d0090 con 0x7fe92c0b3540 2024-09-19T05:38:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c030b80 con 0x7fe92c0b3540 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.743+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c15dbb0 con 0x7fe92c0b3540 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.744+0000 7fe934781640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0cf170 0x7fe92c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.744+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c15da10 con 0x7fe92c0cf170 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.744+0000 7fe931d1c640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0cf170 0x7fe92c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.744+0000 7fe931d1c640 1 -- 172.21.15.103:0/2343872507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe92c15d730 con 0x7fe92c0cf170 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe931d1c640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0cf170 0x7fe92c0cf550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe92c15e310 tx=0x7fe928001880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928011580 con 0x7fe92c0cf170 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe91c044020 con 0x7fe92c0b3540 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe91006c1b0 0x7fe91006e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe91c0abcb0 con 0x7fe92c0b3540 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe932d1e640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe91006c1b0 0x7fe91006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe928011720 con 0x7fe92c0cf170 2024-09-19T05:38:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0cf170 msgr2=0x7fe92c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0cf170 0x7fe92c0cf550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe92c15e310 tx=0x7fe928001880 comp rx=0 tx=0).stop 2024-09-19T05:38:39.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0cf170 msgr2=0x7fe92c0cf550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:39.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.745+0000 7fe922ffd640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0cf170 0x7fe92c0cf550 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.746+0000 7fe932d1e640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe91006c1b0 0x7fe91006e670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe92c15af80 tx=0x7fe924007780 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.751+0000 7fe934781640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c1f4070 0x7fe92c1f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.751+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c0cb540 con 0x7fe92c1f4070 2024-09-19T05:38:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe931d1c640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c1f4070 0x7fe92c1f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe931d1c640 1 -- 172.21.15.103:0/2343872507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe92c069380 con 0x7fe92c1f4070 2024-09-19T05:38:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe931d1c640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c1f4070 0x7fe92c1f4450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0b31c0 tx=0x7fe928000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92801e320 con 0x7fe92c1f4070 2024-09-19T05:38:39.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fe92801e320 con 0x7fe92c1f4070 2024-09-19T05:38:39.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c1f4070 msgr2=0x7fe92c1f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe922ffd640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c1f4070 0x7fe92c1f4450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0b31c0 tx=0x7fe928000ed0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe922ffd640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c1f4070 msgr2=0x7fe92c1f4450 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:39.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.752+0000 7fe922ffd640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c1f4070 0x7fe92c1f4450 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0b31c0 tx=0x7fe928000ed0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 4, 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 79885, 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:38:39.756 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 79, 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:39.758 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:39.759 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.761 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:38:39.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.762 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:38:39.762 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:38:39.762 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:39.762 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:39.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.762 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:38:39.763 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:39.766 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.767 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.768 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.769 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:39.770 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.771 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.771 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:38:39.771 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:39.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe91006c1b0 msgr2=0x7fe91006e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe91006c1b0 0x7fe91006e670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe92c15af80 tx=0x7fe924007780 comp rx=0 tx=0).stop 2024-09-19T05:38:39.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0b3540 msgr2=0x7fe92c14dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 --2- 172.21.15.103:0/2343872507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe92c0b3540 0x7fe92c14dee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe91c035040 tx=0x7fe91c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe932d1e640 1 -- 172.21.15.103:0/2343872507 reap_dead start 2024-09-19T05:38:39.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe932d1e640 1 -- 172.21.15.103:0/2343872507 reap_dead start 2024-09-19T05:38:39.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 shutdown_connections 2024-09-19T05:38:39.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 >> 172.21.15.103:0/2343872507 conn(0x7fe92c073340 msgr2=0x7fe92c0c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 shutdown_connections 2024-09-19T05:38:39.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.753+0000 7fe934781640 1 -- 172.21.15.103:0/2343872507 wait complete. 2024-09-19T05:38:39.773 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:38:39.773 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T05:38:39.774 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T05:38:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.873+0000 7f9cdf842640 1 Processor -- start 2024-09-19T05:38:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.874+0000 7f9cdf842640 1 -- start start 2024-09-19T05:38:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.874+0000 7f9cdf842640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 0x7f9cd815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.874+0000 7f9cdf842640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd80ca7e0 0x7f9cd8154c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.874+0000 7f9cdf842640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd80ceb20 con 0x7f9cd8073c80 2024-09-19T05:38:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.874+0000 7f9cdf842640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd815e8f0 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.874+0000 7f9cdf842640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd80cee00 con 0x7f9cd8074060 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cddddf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd80ca7e0 0x7f9cd8154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cddddf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd80ca7e0 0x7f9cd8154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57354/0 (socket says 172.21.15.103:57354) 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cddddf640 1 -- 172.21.15.103:0/132325201 learned_addr learned my addr 172.21.15.103:0/132325201 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cdcddd640 1 --2- 172.21.15.103:0/132325201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 0x7f9cd815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cddddf640 1 -- 172.21.15.103:0/132325201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 msgr2=0x7f9cd815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cddddf640 1 --2- 172.21.15.103:0/132325201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 0x7f9cd815ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cddddf640 1 -- 172.21.15.103:0/132325201 >> v1:172.21.15.174:6789/0 conn(0x7f9cd8073c80 legacy=0x7f9cd80c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.875+0000 7f9cddddf640 1 -- 172.21.15.103:0/132325201 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd80cf0e0 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cddddf640 1 --2- 172.21.15.103:0/132325201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd8154c40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009e50 tx=0x7f9cd002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198d207e9a6cbd93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9ccffff640 1 -- 172.21.15.103:0/132325201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0036070 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9ccffff640 1 -- 172.21.15.103:0/132325201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd0031600 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9ccffff640 1 -- 172.21.15.103:0/132325201 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00319d0 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 -- 172.21.15.103:0/132325201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 msgr2=0x7f9cd8154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 --2- 172.21.15.103:0/132325201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd8154c40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009e50 tx=0x7f9cd002a7a0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 -- 172.21.15.103:0/132325201 shutdown_connections 2024-09-19T05:38:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 --2- 172.21.15.103:0/132325201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd8154c40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 --2- 172.21.15.103:0/132325201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 0x7f9cd815ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 -- 172.21.15.103:0/132325201 >> 172.21.15.103:0/132325201 conn(0x7f9cd806f890 msgr2=0x7f9cd8071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 -- 172.21.15.103:0/132325201 shutdown_connections 2024-09-19T05:38:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.876+0000 7f9cdf842640 1 -- 172.21.15.103:0/132325201 wait complete. 2024-09-19T05:38:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 Processor -- start 2024-09-19T05:38:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 -- start start 2024-09-19T05:38:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8073c80 0x7f9cd815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 0x7f9cd81f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd81f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80ce6e0 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd815f2c0 con 0x7f9cd8073c80 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cdf842640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd80ce860 con 0x7f9cd8074060 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.878+0000 7f9cddddf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd81f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd81f1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57362/0 (socket says 172.21.15.103:57362) 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cdd5de640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8073c80 0x7f9cd815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 -- 172.21.15.103:0/769015877 learned_addr learned my addr 172.21.15.103:0/769015877 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cdcddd640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 0x7f9cd81f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 msgr2=0x7f9cd81f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cd8074060 0x7f9cd81f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8073c80 msgr2=0x7f9cd815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8073c80 0x7f9cd815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 -- 172.21.15.103:0/769015877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd8151e30 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cddddf640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd81f1510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0034040 tx=0x7f9cd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0036050 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd0042070 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0009510 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd814f2d0 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.879+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd8154fb0 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.880+0000 7f9cdf842640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8150b40 0x7f9cd8150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.880+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd806e550 con 0x7f9cd8150b40 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.880+0000 7f9cdd5de640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8150b40 0x7f9cd8150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.881+0000 7f9cdd5de640 1 -- 172.21.15.103:0/769015877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cd80ca290 con 0x7f9cd8150b40 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.881+0000 7f9cdd5de640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8150b40 0x7f9cd8150f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f470 tx=0x7f9cd400f930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.881+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9cd0007bf0 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.881+0000 7f9ccdffb640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.881+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9cd00ac420 con 0x7f9cd80ca7e0 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.881+0000 7f9cdcddd640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.882+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4019070 con 0x7f9cd8150b40 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.882+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9cd4005320 con 0x7f9cd8150b40 2024-09-19T05:38:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.882+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8150b40 msgr2=0x7f9cd8150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.882+0000 7f9ccdffb640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8150b40 0x7f9cd8150f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f470 tx=0x7f9cd400f930 comp rx=0 tx=0).stop 2024-09-19T05:38:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.882+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8150b40 msgr2=0x7f9cd8150f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.882+0000 7f9ccdffb640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8150b40 0x7f9cd8150f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.882+0000 7f9cdcddd640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9cd81e5fd0 tx=0x7f9cc8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.888+0000 7f9cdf842640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8151460 0x7f9cd81f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.888+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81f0c80 con 0x7f9cd8151460 2024-09-19T05:38:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.888+0000 7f9cdd5de640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8151460 0x7f9cd81f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.888+0000 7f9cdd5de640 1 -- 172.21.15.103:0/769015877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cd814ec40 con 0x7f9cd8151460 2024-09-19T05:38:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.888+0000 7f9cdd5de640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8151460 0x7f9cd81f41f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f470 tx=0x7f9cd4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4019030 con 0x7f9cd8151460 2024-09-19T05:38:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f9cd4006ce0 con 0x7f9cd8151460 2024-09-19T05:38:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8151460 msgr2=0x7f9cd81f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9ccdffb640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8151460 0x7f9cd81f41f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f470 tx=0x7f9cd4000ed0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9ccdffb640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8151460 msgr2=0x7f9cd81f41f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9ccdffb640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cd8151460 0x7f9cd81f41f0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400f470 tx=0x7f9cd4000ed0 comp rx=0 tx=0).stop 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 4, 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 79982, 2024-09-19T05:38:39.892 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 79, 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:39.893 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:39.894 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:38:39.895 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:38:39.896 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:38:39.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:39.898 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:38:39.899 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:39.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:39.902 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:38:39.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:38:39.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:39.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:39.906 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:38:39.906 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9cbc06c2b0 msgr2=0x7f9cbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9cd81e5fd0 tx=0x7f9cc8009190 comp rx=0 tx=0).stop 2024-09-19T05:38:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 msgr2=0x7f9cd81f1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 --2- 172.21.15.103:0/769015877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca7e0 0x7f9cd81f1510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0034040 tx=0x7f9cd0004a40 comp rx=0 tx=0).stop 2024-09-19T05:38:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cddddf640 1 -- 172.21.15.103:0/769015877 reap_dead start 2024-09-19T05:38:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cddddf640 1 -- 172.21.15.103:0/769015877 reap_dead start 2024-09-19T05:38:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 shutdown_connections 2024-09-19T05:38:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 >> 172.21.15.103:0/769015877 conn(0x7f9cd806f890 msgr2=0x7f9cd80cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 shutdown_connections 2024-09-19T05:38:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:39.889+0000 7f9cdf842640 1 -- 172.21.15.103:0/769015877 wait complete. 2024-09-19T05:38:39.908 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:38:39.908 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T05:38:39.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T05:38:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.005+0000 7f1a57f11640 1 Processor -- start 2024-09-19T05:38:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.006+0000 7f1a57f11640 1 -- start start 2024-09-19T05:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.006+0000 7f1a57f11640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a5015af30 0x7f1a500c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.006+0000 7f1a57f11640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a501556c0 con 0x7f1a501552e0 2024-09-19T05:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.006+0000 7f1a57f11640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5015b3e0 con 0x7f1a50070700 2024-09-19T05:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a57f11640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1a500c82d0 con 0x7f1a5015af30 2024-09-19T05:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a554ac640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a5015af30 0x7f1a500c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a55cad640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1a501552e0 0x7f1a5006fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40842/0 (socket says 172.21.15.103:40842) 2024-09-19T05:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a55cad640 1 -- 172.21.15.103:0/202017 learned_addr learned my addr 172.21.15.103:0/202017 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a554ac640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a5015af30 0x7f1a500c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57376/0 (socket says 172.21.15.103:57376) 2024-09-19T05:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a554ac640 1 -- 172.21.15.103:0/202017 >> v1:172.21.15.174:6789/0 conn(0x7f1a50070700 legacy=0x7f1a500c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a554ac640 1 -- 172.21.15.103:0/202017 >> v1:172.21.15.103:6789/0 conn(0x7f1a501552e0 legacy=0x7f1a5006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a54cab640 1 -- 172.21.15.103:0/202017 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149540012 0 0) 0x7f1a48001110 con 0x7f1a501552e0 2024-09-19T05:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.007+0000 7f1a554ac640 1 -- 172.21.15.103:0/202017 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5015b6c0 con 0x7f1a5015af30 2024-09-19T05:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a554ac640 1 --2- 172.21.15.103:0/202017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a5015af30 0x7f1a500c9290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9def29df8992284c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a54cab640 1 -- 172.21.15.103:0/202017 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44037070 con 0x7f1a5015af30 2024-09-19T05:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a54cab640 1 -- 172.21.15.103:0/202017 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a44032440 con 0x7f1a5015af30 2024-09-19T05:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a54cab640 1 -- 172.21.15.103:0/202017 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44032810 con 0x7f1a5015af30 2024-09-19T05:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a57f11640 1 -- 172.21.15.103:0/202017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a5015af30 msgr2=0x7f1a500c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a57f11640 1 --2- 172.21.15.103:0/202017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a5015af30 0x7f1a500c9290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a4402a1e0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a57f11640 1 -- 172.21.15.103:0/202017 shutdown_connections 2024-09-19T05:38:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a57f11640 1 --2- 172.21.15.103:0/202017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a5015af30 0x7f1a500c9290 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a57f11640 1 -- 172.21.15.103:0/202017 >> 172.21.15.103:0/202017 conn(0x7f1a500ca140 msgr2=0x7f1a500ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a57f11640 1 -- 172.21.15.103:0/202017 shutdown_connections 2024-09-19T05:38:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.008+0000 7f1a57f11640 1 -- 172.21.15.103:0/202017 wait complete. 2024-09-19T05:38:40.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.009+0000 7f1a57f11640 1 Processor -- start 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a57f11640 1 -- start start 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a57f11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a50070700 0x7f1a501542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a57f11640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a501552e0 0x7f1a501f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a57f11640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5015af30 0x7f1a501f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a57f11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5006fad0 con 0x7f1a50070700 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a57f11640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5015bc80 con 0x7f1a501552e0 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a57f11640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1a500c8cd0 con 0x7f1a5015af30 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a55cad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a50070700 0x7f1a501542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a55cad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a50070700 0x7f1a501542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57378/0 (socket says 172.21.15.103:57378) 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a55cad640 1 -- 172.21.15.103:0/3407502373 learned_addr learned my addr 172.21.15.103:0/3407502373 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a554ac640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a501552e0 0x7f1a501f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.010+0000 7f1a564ae640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5015af30 0x7f1a501f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a55cad640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5015af30 msgr2=0x7f1a501f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a55cad640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5015af30 0x7f1a501f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a55cad640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a501552e0 msgr2=0x7f1a501f1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a55cad640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a501552e0 0x7f1a501f1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a55cad640 1 -- 172.21.15.103:0/3407502373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a501f46f0 con 0x7f1a50070700 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a554ac640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a501552e0 0x7f1a501f1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a55cad640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a50070700 0x7f1a501542d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c750 tx=0x7f1a4800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48017070 con 0x7f1a50070700 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a48005ab0 con 0x7f1a50070700 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48007070 con 0x7f1a50070700 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a501f49d0 con 0x7f1a50070700 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.011+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a501f4f90 con 0x7f1a50070700 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.012+0000 7f1a57f11640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a501f0f30 0x7f1a50149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.012+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1a501f44a0 con 0x7f1a501f0f30 2024-09-19T05:38:40.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.012+0000 7f1a554ac640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a501f0f30 0x7f1a50149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.012+0000 7f1a554ac640 1 -- 172.21.15.103:0/3407502373 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a5006bc10 con 0x7f1a501f0f30 2024-09-19T05:38:40.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.012+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1a4801a070 con 0x7f1a50070700 2024-09-19T05:38:40.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.012+0000 7f1a554ac640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a501f0f30 0x7f1a50149eb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a500cb180 tx=0x7f1a440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1a3c06c2b0 0x7f1a3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1a4808ad20 con 0x7f1a50070700 2024-09-19T05:38:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a564ae640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1a3c06c2b0 0x7f1a3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44037040 con 0x7f1a501f0f30 2024-09-19T05:38:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a44032e20 con 0x7f1a501f0f30 2024-09-19T05:38:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a501f0f30 msgr2=0x7f1a50149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a501f0f30 0x7f1a50149eb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a500cb180 tx=0x7f1a440046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a501f0f30 msgr2=0x7f1a50149eb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:40.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a4e7fc640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a501f0f30 0x7f1a50149eb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.013+0000 7f1a564ae640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1a3c06c2b0 0x7f1a3c06e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a40005520 tx=0x7f1a40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.019+0000 7f1a57f11640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5014c840 0x7f1a5014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.019+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1a500c4750 con 0x7f1a5014c840 2024-09-19T05:38:40.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.019+0000 7f1a554ac640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5014c840 0x7f1a5014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a554ac640 1 -- 172.21.15.103:0/3407502373 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a500c8040 con 0x7f1a5014c840 2024-09-19T05:38:40.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a554ac640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5014c840 0x7f1a5014a3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a44008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44037070 con 0x7f1a5014c840 2024-09-19T05:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f1a4403ce50 con 0x7f1a5014c840 2024-09-19T05:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5014c840 msgr2=0x7f1a5014a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a4e7fc640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5014c840 0x7f1a5014a3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a44008030 comp rx=0 tx=0).stop 2024-09-19T05:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a4e7fc640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5014c840 msgr2=0x7f1a5014a3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.020+0000 7f1a4e7fc640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1a5014c840 0x7f1a5014a3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.023 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 4, 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 80114, 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 79, 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.030 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:38:40.031 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1a3c06c2b0 msgr2=0x7f1a3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f1a3c06c2b0 0x7f1a3c06e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a40005520 tx=0x7f1a40009040 comp rx=0 tx=0).stop 2024-09-19T05:38:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a50070700 msgr2=0x7f1a501542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a50070700 0x7f1a501542d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c750 tx=0x7f1a4800cb50 comp rx=0 tx=0).stop 2024-09-19T05:38:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a564ae640 1 -- 172.21.15.103:0/3407502373 reap_dead start 2024-09-19T05:38:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 shutdown_connections 2024-09-19T05:38:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 --2- 172.21.15.103:0/3407502373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a50070700 0x7f1a501542d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 >> 172.21.15.103:0/3407502373 conn(0x7f1a500ca140 msgr2=0x7f1a50072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 shutdown_connections 2024-09-19T05:38:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.021+0000 7f1a57f11640 1 -- 172.21.15.103:0/3407502373 wait complete. 2024-09-19T05:38:40.039 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:38:40.040 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-19T05:38:40.040 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T05:38:40.040 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-19T05:38:40.040 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-19T05:38:40.040 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T05:38:40.040 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:38:40.054 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T05:38:40.054 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T05:38:40.055 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:38:40.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.151+0000 7fe850084640 1 Processor -- start 2024-09-19T05:38:40.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.151+0000 7fe850084640 1 -- start start 2024-09-19T05:38:40.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe850084640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 0x7fe8480cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe850084640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8480cbed0 con 0x7fe848155040 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe850084640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84815bd70 con 0x7fe8480b3540 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe850084640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8480cbbf0 con 0x7fe8480c5950 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe84de20640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe848155040 0x7fe84815e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40846/0 (socket says 172.21.15.103:40846) 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe84de20640 1 -- 172.21.15.103:0/739847200 learned_addr learned my addr 172.21.15.103:0/739847200 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe84e621640 1 -- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 msgr2=0x7fe8480cb540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.152+0000 7fe84e621640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 0x7fe8480cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472120664 0 0) 0x7fe8480cbed0 con 0x7fe848155040 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe830003520 con 0x7fe848155040 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1577444229 0 0) 0x7fe830003520 con 0x7fe848155040 2024-09-19T05:38:40.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 msgr2=0x7fe8480cb540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 0x7fe8480cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 >> v1:172.21.15.174:6789/0 conn(0x7fe8480b3540 legacy=0x7fe8480cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84815afb0 con 0x7fe848155040 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fe8380019f0 con 0x7fe848155040 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 >> v1:172.21.15.103:6789/0 conn(0x7fe848155040 legacy=0x7fe84815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8300039e0 0x7fe830003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 0x7fe830004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe830004d90 0x7fe830005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe8480cbbf0 con 0x7fe8300039e0 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe83000bba0 con 0x7fe830004d90 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe83000bda0 con 0x7fe8480c5950 2024-09-19T05:38:40.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84de20640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8300039e0 0x7fe830003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84d61f640 1 -- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 msgr2=0x7fe830004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84d61f640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 0x7fe830004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84e621640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe830004d90 0x7fe830005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84de20640 1 -- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 msgr2=0x7fe830004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84de20640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8480c5950 0x7fe830004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84de20640 1 -- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe830004d90 msgr2=0x7fe830005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84de20640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe830004d90 0x7fe830005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84de20640 1 -- 172.21.15.103:0/739847200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe830003520 con 0x7fe8300039e0 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.153+0000 7fe84e621640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe830004d90 0x7fe830005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.154+0000 7fe84de20640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8300039e0 0x7fe830003e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe83800a830 tx=0x7fe830005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6958f5caf9b84e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.154+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83800a450 con 0x7fe8300039e0 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.154+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83802f070 con 0x7fe8300039e0 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.154+0000 7fe84ce1e640 1 -- 172.21.15.103:0/739847200 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83802bc70 con 0x7fe8300039e0 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.155+0000 7fe850084640 1 -- 172.21.15.103:0/739847200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8300039e0 msgr2=0x7fe830003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.155+0000 7fe850084640 1 --2- 172.21.15.103:0/739847200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8300039e0 0x7fe830003e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe83800a830 tx=0x7fe830005830 comp rx=0 tx=0).stop 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.155+0000 7fe84e621640 1 -- 172.21.15.103:0/739847200 reap_dead start 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.155+0000 7fe850084640 1 -- 172.21.15.103:0/739847200 shutdown_connections 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.155+0000 7fe850084640 1 -- 172.21.15.103:0/739847200 >> 172.21.15.103:0/739847200 conn(0x7fe848073340 msgr2=0x7fe848073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.155+0000 7fe850084640 1 -- 172.21.15.103:0/739847200 shutdown_connections 2024-09-19T05:38:40.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.155+0000 7fe850084640 1 -- 172.21.15.103:0/739847200 wait complete. 2024-09-19T05:38:40.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.156+0000 7fe850084640 1 Processor -- start 2024-09-19T05:38:40.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.156+0000 7fe850084640 1 -- start start 2024-09-19T05:38:40.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8300039e0 0x7fe84814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe848158a70 0x7fe8481f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8481f4aa0 0x7fe84814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe84815b850 con 0x7fe848158a70 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe84815b570 con 0x7fe8481f4aa0 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe84815eb30 con 0x7fe8300039e0 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe848158a70 0x7fe8481f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84de20640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8300039e0 msgr2=0x7fe84814e540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe848158a70 0x7fe8481f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57406/0 (socket says 172.21.15.103:57406) 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 -- 172.21.15.103:0/1405582219 learned_addr learned my addr 172.21.15.103:0/1405582219 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84de20640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8300039e0 0x7fe84814e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84e621640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8481f4aa0 0x7fe84814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 -- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8300039e0 msgr2=0x7fe84814e540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8300039e0 0x7fe84814e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 -- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8481f4aa0 msgr2=0x7fe84814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8481f4aa0 0x7fe84814fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 -- 172.21.15.103:0/1405582219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8480b6550 con 0x7fe848158a70 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe84d61f640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe848158a70 0x7fe8481f4560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00c580 tx=0x7fe83c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe8467fc640 1 -- 172.21.15.103:0/1405582219 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c017070 con 0x7fe848158a70 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe8467fc640 1 -- 172.21.15.103:0/1405582219 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83c007520 con 0x7fe848158a70 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8480b67f0 con 0x7fe848158a70 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe8467fc640 1 -- 172.21.15.103:0/1405582219 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c005a00 con 0x7fe848158a70 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.157+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe84815ac00 con 0x7fe848158a70 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.158+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8480cb540 con 0x7fe848158a70 2024-09-19T05:38:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.159+0000 7fe8467fc640 1 -- 172.21.15.103:0/1405582219 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe83c01a070 con 0x7fe848158a70 2024-09-19T05:38:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.159+0000 7fe8467fc640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe83406c290 0x7fe83406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.160+0000 7fe84de20640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe83406c290 0x7fe83406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.160+0000 7fe8467fc640 1 -- 172.21.15.103:0/1405582219 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe83c08abe0 con 0x7fe848158a70 2024-09-19T05:38:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.160+0000 7fe84de20640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe83406c290 0x7fe83406e750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe838033000 tx=0x7fe838038040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.164+0000 7fe8467fc640 1 -- 172.21.15.103:0/1405582219 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe83c058fe0 con 0x7fe848158a70 2024-09-19T05:38:40.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.400+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe848069380 con 0x7fe848158a70 2024-09-19T05:38:40.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.400+0000 7fe8467fc640 1 -- 172.21.15.103:0/1405582219 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fe83c05de20 con 0x7fe848158a70 2024-09-19T05:38:40.403 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":80,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:38:40.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe83406c290 msgr2=0x7fe83406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe83406c290 0x7fe83406e750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe838033000 tx=0x7fe838038040 comp rx=0 tx=0).stop 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe848158a70 msgr2=0x7fe8481f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe848158a70 0x7fe8481f4560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00c580 tx=0x7fe83c00ca40 comp rx=0 tx=0).stop 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 shutdown_connections 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe83406c290 0x7fe83406e750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8481f4aa0 0x7fe84814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe848158a70 0x7fe8481f4560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 --2- 172.21.15.103:0/1405582219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8300039e0 0x7fe84814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 >> 172.21.15.103:0/1405582219 conn(0x7fe848073340 msgr2=0x7fe848150b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 shutdown_connections 2024-09-19T05:38:40.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:40.403+0000 7fe850084640 1 -- 172.21.15.103:0/1405582219 wait complete. 2024-09-19T05:38:42.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:42.339 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:38:43.417 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:38:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.523+0000 7fd99e349640 1 Processor -- start 2024-09-19T05:38:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.523+0000 7fd99e349640 1 -- start start 2024-09-19T05:38:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd99e349640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd99806bc10 0x7fd9980c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd99e349640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd99806d440 0x7fd9980c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd99e349640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd998158e00 con 0x7fd998152a80 2024-09-19T05:38:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd99e349640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd9980c7b80 con 0x7fd99806bc10 2024-09-19T05:38:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd99e349640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd9981590e0 con 0x7fd99806d440 2024-09-19T05:38:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd99c8e6640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd99806d440 msgr2=0x7fd9980c5080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd9977fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd99806bc10 0x7fd9980c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd99c8e6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd99806d440 0x7fd9980c5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd9977fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd99806bc10 0x7fd9980c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34032/0 (socket says 172.21.15.103:34032) 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.524+0000 7fd9977fe640 1 -- 172.21.15.103:0/2008618336 learned_addr learned my addr 172.21.15.103:0/2008618336 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.525+0000 7fd9977fe640 1 -- 172.21.15.103:0/2008618336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd99806d440 msgr2=0x7fd9980c5080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.525+0000 7fd9977fe640 1 --2- 172.21.15.103:0/2008618336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd99806d440 0x7fd9980c5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.525+0000 7fd9977fe640 1 -- 172.21.15.103:0/2008618336 >> v1:172.21.15.174:6789/0 conn(0x7fd998152a80 legacy=0x7fd99806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.525+0000 7fd9977fe640 1 -- 172.21.15.103:0/2008618336 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9981593c0 con 0x7fd99806bc10 2024-09-19T05:38:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.525+0000 7fd9977fe640 1 --2- 172.21.15.103:0/2008618336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806bc10 0x7fd9980c4b40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009870 tx=0x7fd98c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5056923f85de1ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd996ffd640 1 -- 172.21.15.103:0/2008618336 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c037070 con 0x7fd99806bc10 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd996ffd640 1 -- 172.21.15.103:0/2008618336 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c032440 con 0x7fd99806bc10 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd996ffd640 1 -- 172.21.15.103:0/2008618336 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c032810 con 0x7fd99806bc10 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 -- 172.21.15.103:0/2008618336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806bc10 msgr2=0x7fd9980c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 --2- 172.21.15.103:0/2008618336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806bc10 0x7fd9980c4b40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009870 tx=0x7fd98c02a270 comp rx=0 tx=0).stop 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 -- 172.21.15.103:0/2008618336 shutdown_connections 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 --2- 172.21.15.103:0/2008618336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd99806d440 0x7fd9980c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 --2- 172.21.15.103:0/2008618336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806bc10 0x7fd9980c4b40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 -- 172.21.15.103:0/2008618336 >> 172.21.15.103:0/2008618336 conn(0x7fd9980ca140 msgr2=0x7fd9980ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 -- 172.21.15.103:0/2008618336 shutdown_connections 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.526+0000 7fd99e349640 1 -- 172.21.15.103:0/2008618336 wait complete. 2024-09-19T05:38:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.527+0000 7fd99e349640 1 Processor -- start 2024-09-19T05:38:43.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99e349640 1 -- start start 2024-09-19T05:38:43.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99e349640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd99806bc10 0x7fd998073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99e349640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806d440 0x7fd99814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99e349640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd998152a80 0x7fd9981f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99e349640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9980c77d0 con 0x7fd99806d440 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99e349640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd9980c55c0 con 0x7fd99806bc10 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99e349640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd9981f1a80 con 0x7fd998152a80 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd9977fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806d440 0x7fd99814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd9977fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806d440 0x7fd99814e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34040/0 (socket says 172.21.15.103:34040) 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99c8e6640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd998152a80 msgr2=0x7fd9981f1540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd9977fe640 1 -- 172.21.15.103:0/824801842 learned_addr learned my addr 172.21.15.103:0/824801842 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.528+0000 7fd99c8e6640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd998152a80 0x7fd9981f1540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd997fff640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd99806bc10 0x7fd998073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd9977fe640 1 -- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd998152a80 msgr2=0x7fd9981f1540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd9977fe640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd998152a80 0x7fd9981f1540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd9977fe640 1 -- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd99806bc10 msgr2=0x7fd998073070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd9977fe640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd99806bc10 0x7fd998073070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd9977fe640 1 -- 172.21.15.103:0/824801842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd998158a10 con 0x7fd99806d440 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd9977fe640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806d440 0x7fd99814e8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd98c000c00 tx=0x7fd98c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd994ff9640 1 -- 172.21.15.103:0/824801842 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c041070 con 0x7fd99806d440 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd994ff9640 1 -- 172.21.15.103:0/824801842 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c03c870 con 0x7fd99806d440 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd998073ea0 con 0x7fd99806d440 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd994ff9640 1 -- 172.21.15.103:0/824801842 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c037040 con 0x7fd99806d440 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.529+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd998074460 con 0x7fd99806d440 2024-09-19T05:38:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.530+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd998152e60 con 0x7fd99806d440 2024-09-19T05:38:43.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.531+0000 7fd994ff9640 1 -- 172.21.15.103:0/824801842 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd98c044070 con 0x7fd99806d440 2024-09-19T05:38:43.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.531+0000 7fd994ff9640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd98406c260 0x7fd98406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:43.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.531+0000 7fd994ff9640 1 -- 172.21.15.103:0/824801842 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd98c0ac060 con 0x7fd99806d440 2024-09-19T05:38:43.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.531+0000 7fd997fff640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd98406c260 0x7fd98406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:43.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.531+0000 7fd997fff640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd98406c260 0x7fd98406e720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd988001640 tx=0x7fd988009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.535+0000 7fd994ff9640 1 -- 172.21.15.103:0/824801842 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd98c04b070 con 0x7fd99806d440 2024-09-19T05:38:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.763+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd998156640 con 0x7fd99806d440 2024-09-19T05:38:43.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.764+0000 7fd994ff9640 1 -- 172.21.15.103:0/824801842 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fd98c07a3e0 con 0x7fd99806d440 2024-09-19T05:38:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":83,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd98406c260 msgr2=0x7fd98406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd98406c260 0x7fd98406e720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd988001640 tx=0x7fd988009040 comp rx=0 tx=0).stop 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806d440 msgr2=0x7fd99814e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806d440 0x7fd99814e8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd98c000c00 tx=0x7fd98c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 shutdown_connections 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd98406c260 0x7fd98406e720 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd998152a80 0x7fd9981f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd99806d440 0x7fd99814e8b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 --2- 172.21.15.103:0/824801842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd99806bc10 0x7fd998073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 >> 172.21.15.103:0/824801842 conn(0x7fd9980ca140 msgr2=0x7fd9980ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:43.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 shutdown_connections 2024-09-19T05:38:43.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:43.766+0000 7fd99e349640 1 -- 172.21.15.103:0/824801842 wait complete. 2024-09-19T05:38:46.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:38:46.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.886+0000 7fbbd9598640 1 Processor -- start 2024-09-19T05:38:46.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.886+0000 7fbbd9598640 1 -- start start 2024-09-19T05:38:46.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd9598640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 0x7fbbd40c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:46.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd9598640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd415bc80 con 0x7fbbd4151ea0 2024-09-19T05:38:46.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd9598640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd4157c70 con 0x7fbbd40c46c0 2024-09-19T05:38:46.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd9598640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd41585a0 con 0x7fbbd40c3a50 2024-09-19T05:38:46.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd2ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbbd4151ea0 0x7fbbd4158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51064/0 (socket says 172.21.15.103:51064) 2024-09-19T05:38:46.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd2ffd640 1 -- 172.21.15.103:0/3334891051 learned_addr learned my addr 172.21.15.103:0/3334891051 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:46.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd37fe640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 msgr2=0x7fbbd40c89b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:46.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:46.887+0000 7fbbd37fe640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 0x7fbbd40c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:47.088+0000 7fbbd37fe640 1 -- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 msgr2=0x7fbbd40c89b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:47.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:47.088+0000 7fbbd37fe640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 0x7fbbd40c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:38:47.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:47.489+0000 7fbbd37fe640 1 -- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 msgr2=0x7fbbd40c89b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:47.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:47.489+0000 7fbbd37fe640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 0x7fbbd40c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:38:48.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:48.290+0000 7fbbd37fe640 1 -- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 msgr2=0x7fbbd40c89b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:48.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:48.290+0000 7fbbd37fe640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 0x7fbbd40c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:38:49.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 -- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 msgr2=0x7fbbd40c89b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:49.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40c3a50 0x7fbbd40c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 -- 172.21.15.103:0/3334891051 >> v1:172.21.15.174:6789/0 conn(0x7fbbd40c46c0 legacy=0x7fbbd406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 -- 172.21.15.103:0/3334891051 >> v1:172.21.15.103:6789/0 conn(0x7fbbd4151ea0 legacy=0x7fbbd4158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 --2- 172.21.15.103:0/3334891051 >> v2:172.21.15.174:3300/0 conn(0x7fbbc0003710 0x7fbbc0005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 --2- 172.21.15.103:0/3334891051 >> v2:172.21.15.103:3300/0 conn(0x7fbbc00061e0 0x7fbbc0008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 -- 172.21.15.103:0/3334891051 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbbd41585a0 con 0x7fbbc00061e0 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd0ff9640 1 -- 172.21.15.103:0/3334891051 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc0008d30 con 0x7fbbc0003710 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd27fc640 1 --2- 172.21.15.103:0/3334891051 >> v2:172.21.15.103:3300/0 conn(0x7fbbc00061e0 0x7fbbc0008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd2ffd640 1 --2- 172.21.15.103:0/3334891051 >> v2:172.21.15.174:3300/0 conn(0x7fbbc0003710 0x7fbbc0005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd27fc640 1 -- 172.21.15.103:0/3334891051 >> v2:172.21.15.174:3300/0 conn(0x7fbbc0003710 msgr2=0x7fbbc0005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd27fc640 1 --2- 172.21.15.103:0/3334891051 >> v2:172.21.15.174:3300/0 conn(0x7fbbc0003710 0x7fbbc0005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.888+0000 7fbbd27fc640 1 -- 172.21.15.103:0/3334891051 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd4157f50 con 0x7fbbc00061e0 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.889+0000 7fbbd27fc640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbc0008680 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00036a0 tx=0x7fbbc802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d11fec59c9356b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.889+0000 7fbbd1ffb640 1 -- 172.21.15.103:0/3334891051 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc802ae60 con 0x7fbbc00061e0 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.889+0000 7fbbd1ffb640 1 -- 172.21.15.103:0/3334891051 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc80050d0 con 0x7fbbc00061e0 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.889+0000 7fbbd1ffb640 1 -- 172.21.15.103:0/3334891051 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80054a0 con 0x7fbbc00061e0 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd9598640 1 -- 172.21.15.103:0/3334891051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 msgr2=0x7fbbc0008680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbc0008680 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00036a0 tx=0x7fbbc802a110 comp rx=0 tx=0).stop 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd37fe640 1 -- 172.21.15.103:0/3334891051 reap_dead start 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd9598640 1 -- 172.21.15.103:0/3334891051 shutdown_connections 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3334891051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbc0008680 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd9598640 1 -- 172.21.15.103:0/3334891051 >> 172.21.15.103:0/3334891051 conn(0x7fbbd40c9230 msgr2=0x7fbbd40c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd9598640 1 -- 172.21.15.103:0/3334891051 shutdown_connections 2024-09-19T05:38:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.890+0000 7fbbd9598640 1 -- 172.21.15.103:0/3334891051 wait complete. 2024-09-19T05:38:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.891+0000 7fbbd9598640 1 Processor -- start 2024-09-19T05:38:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd9598640 1 -- start start 2024-09-19T05:38:49.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd9598640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbd41f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:49.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd9598640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd414cf80 0x7fbbd414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd9598640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40cb7e0 0x7fbbd415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd9598640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd41596e0 con 0x7fbbc00061e0 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd9598640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd4152280 con 0x7fbbd414cf80 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd9598640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd4158a30 con 0x7fbbd40cb7e0 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.892+0000 7fbbd2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbd41f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd37fe640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40cb7e0 msgr2=0x7fbbd415aef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbd41f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34056/0 (socket says 172.21.15.103:34056) 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 -- 172.21.15.103:0/3789298137 learned_addr learned my addr 172.21.15.103:0/3789298137 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd37fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40cb7e0 0x7fbbd415aef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd27fc640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd414cf80 0x7fbbd414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 -- 172.21.15.103:0/3789298137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40cb7e0 msgr2=0x7fbbd415aef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40cb7e0 0x7fbbd415aef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 -- 172.21.15.103:0/3789298137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd414cf80 msgr2=0x7fbbd414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd414cf80 0x7fbbd414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 -- 172.21.15.103:0/3789298137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd41f4430 con 0x7fbbc00061e0 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd2ffd640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbd41f3ef0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4001750 tx=0x7fbbc4001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbbb7fe640 1 -- 172.21.15.103:0/3789298137 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc401a070 con 0x7fbbc00061e0 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbbb7fe640 1 -- 172.21.15.103:0/3789298137 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc4007740 con 0x7fbbc00061e0 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd414c4e0 con 0x7fbbc00061e0 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbbb7fe640 1 -- 172.21.15.103:0/3789298137 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400fbc0 con 0x7fbbc00061e0 2024-09-19T05:38:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.893+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd414c780 con 0x7fbbc00061e0 2024-09-19T05:38:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.895+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd415bf20 con 0x7fbbc00061e0 2024-09-19T05:38:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.895+0000 7fbbbb7fe640 1 -- 172.21.15.103:0/3789298137 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbbc401d070 con 0x7fbbc00061e0 2024-09-19T05:38:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.896+0000 7fbbbb7fe640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbbc006d0d0 0x7fbbc006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.896+0000 7fbbbb7fe640 1 -- 172.21.15.103:0/3789298137 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbbc408b0d0 con 0x7fbbc00061e0 2024-09-19T05:38:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.896+0000 7fbbd27fc640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbbc006d0d0 0x7fbbc006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.897+0000 7fbbd27fc640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbbc006d0d0 0x7fbbc006f590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8032000 tx=0x7fbbc802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:49.901+0000 7fbbbb7fe640 1 -- 172.21.15.103:0/3789298137 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbbc4059440 con 0x7fbbc00061e0 2024-09-19T05:38:50.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:50.136+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbbd41e2ac0 con 0x7fbbc00061e0 2024-09-19T05:38:55.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.003+0000 7fbbbb7fe640 1 -- 172.21.15.103:0/3789298137 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1561 (secure 0 0 0) 0x7fbbc4058d40 con 0x7fbbc00061e0 2024-09-19T05:38:55.005 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":8,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbbc006d0d0 msgr2=0x7fbbc006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbbc006d0d0 0x7fbbc006f590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8032000 tx=0x7fbbc802e000 comp rx=0 tx=0).stop 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 msgr2=0x7fbbd41f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbd41f3ef0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4001750 tx=0x7fbbc4001c10 comp rx=0 tx=0).stop 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 shutdown_connections 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbbc006d0d0 0x7fbbc006f590 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd40cb7e0 0x7fbbd415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd414cf80 0x7fbbd414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 --2- 172.21.15.103:0/3789298137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc00061e0 0x7fbbd41f3ef0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 >> 172.21.15.103:0/3789298137 conn(0x7fbbd40c9230 msgr2=0x7fbbd4150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 shutdown_connections 2024-09-19T05:38:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.005+0000 7fbbd9598640 1 -- 172.21.15.103:0/3789298137 wait complete. 2024-09-19T05:38:55.020 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T05:38:55.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T05:38:55.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T05:38:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.119+0000 7fe2cdb4b640 1 Processor -- start 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.119+0000 7fe2cdb4b640 1 -- start start 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.120+0000 7fe2cdb4b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2c81530a0 0x7fe2c815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.120+0000 7fe2cdb4b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 0x7fe2c80c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.120+0000 7fe2cdb4b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c80c8a90 con 0x7fe2c8152cc0 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.120+0000 7fe2cdb4b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c80cf570 con 0x7fe2c81530a0 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.120+0000 7fe2cdb4b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c815d000 con 0x7fe2c815cbb0 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.120+0000 7fe2c7fff640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 msgr2=0x7fe2c80c5ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.120+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 0x7fe2c80c5ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c6ffd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2c81530a0 0x7fe2c815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c77fe640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe2c8152cc0 0x7fe2c8071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:41764/0 (socket says 172.21.15.103:41764) 2024-09-19T05:38:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c77fe640 1 -- 172.21.15.103:0/2821324896 learned_addr learned my addr 172.21.15.103:0/2821324896 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c6ffd640 1 -- 172.21.15.103:0/2821324896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 msgr2=0x7fe2c80c5ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c6ffd640 1 --2- 172.21.15.103:0/2821324896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 0x7fe2c80c5ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c6ffd640 1 -- 172.21.15.103:0/2821324896 >> v1:172.21.15.174:6789/0 conn(0x7fe2c8152cc0 legacy=0x7fe2c8071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c67fc640 1 -- 172.21.15.103:0/2821324896 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120935850 0 0) 0x7fe2c80c8a90 con 0x7fe2c8152cc0 2024-09-19T05:38:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.121+0000 7fe2c6ffd640 1 -- 172.21.15.103:0/2821324896 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c80c7f10 con 0x7fe2c81530a0 2024-09-19T05:38:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.122+0000 7fe2c6ffd640 1 --2- 172.21.15.103:0/2821324896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c81530a0 0x7fe2c815c670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34f52714c2162f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.122+0000 7fe2c67fc640 1 -- 172.21.15.103:0/2821324896 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc037070 con 0x7fe2c81530a0 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.122+0000 7fe2c67fc640 1 -- 172.21.15.103:0/2821324896 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc032440 con 0x7fe2c81530a0 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.122+0000 7fe2c67fc640 1 -- 172.21.15.103:0/2821324896 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc032810 con 0x7fe2c81530a0 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/2821324896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c81530a0 msgr2=0x7fe2c815c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 --2- 172.21.15.103:0/2821324896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c81530a0 0x7fe2c815c670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc02a230 comp rx=0 tx=0).stop 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/2821324896 shutdown_connections 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 --2- 172.21.15.103:0/2821324896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 0x7fe2c80c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 --2- 172.21.15.103:0/2821324896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c81530a0 0x7fe2c815c670 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/2821324896 >> 172.21.15.103:0/2821324896 conn(0x7fe2c806f910 msgr2=0x7fe2c80735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/2821324896 shutdown_connections 2024-09-19T05:38:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.123+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/2821324896 wait complete. 2024-09-19T05:38:55.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.125+0000 7fe2cdb4b640 1 Processor -- start 2024-09-19T05:38:55.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.125+0000 7fe2cdb4b640 1 -- start start 2024-09-19T05:38:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2cdb4b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c8152cc0 0x7fe2c81ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2cdb4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c81530a0 0x7fe2c8144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2cdb4b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 0x7fe2c80cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2cdb4b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c80c87b0 con 0x7fe2c81530a0 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2cdb4b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c80c84d0 con 0x7fe2c8152cc0 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2cdb4b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c815c150 con 0x7fe2c815cbb0 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2c7fff640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 msgr2=0x7fe2c80cd780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 0x7fe2c80cd780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c81530a0 0x7fe2c8144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c81530a0 0x7fe2c8144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59452/0 (socket says 172.21.15.103:59452) 2024-09-19T05:38:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2c6ffd640 1 -- 172.21.15.103:0/3800426201 learned_addr learned my addr 172.21.15.103:0/3800426201 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.126+0000 7fe2c77fe640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c8152cc0 0x7fe2c81ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2c6ffd640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 msgr2=0x7fe2c80cd780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2c6ffd640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2c815cbb0 0x7fe2c80cd780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2c6ffd640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c8152cc0 msgr2=0x7fe2c81ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2c6ffd640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c8152cc0 0x7fe2c81ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2c6ffd640 1 -- 172.21.15.103:0/3800426201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c814e760 con 0x7fe2c81530a0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2c6ffd640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c81530a0 0x7fe2c8144090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc041070 con 0x7fe2c81530a0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc03c870 con 0x7fe2c81530a0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c814ea40 con 0x7fe2c81530a0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc037040 con 0x7fe2c81530a0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.127+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c814d690 con 0x7fe2c81530a0 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.128+0000 7fe2cdb4b640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814e2d0 0x7fe2c81f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.128+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c81ef710 con 0x7fe2c814e2d0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.128+0000 7fe2c77fe640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814e2d0 0x7fe2c81f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.128+0000 7fe2c77fe640 1 -- 172.21.15.103:0/3800426201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2c80c7b90 con 0x7fe2c814e2d0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2c77fe640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814e2d0 0x7fe2c81f1cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8000c00 tx=0x7fe2b8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2bc044070 con 0x7fe2c81530a0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe2b406c260 0x7fe2b406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe2bc0ac040 con 0x7fe2c81530a0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2c7fff640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe2b406c260 0x7fe2b406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800f630 con 0x7fe2c814e2d0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe2b8018070 con 0x7fe2c814e2d0 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814e2d0 msgr2=0x7fe2c81f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814e2d0 0x7fe2c81f1cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8000c00 tx=0x7fe2b8001970 comp rx=0 tx=0).stop 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814e2d0 msgr2=0x7fe2c81f1cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.129+0000 7fe2affff640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814e2d0 0x7fe2c81f1cc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.130+0000 7fe2c7fff640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe2b406c260 0x7fe2b406e720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8153d90 tx=0x7fe2c00091f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.135+0000 7fe2cdb4b640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814de70 0x7fe2c8141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.135+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8069380 con 0x7fe2c814de70 2024-09-19T05:38:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.135+0000 7fe2c77fe640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814de70 0x7fe2c8141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2c77fe640 1 -- 172.21.15.103:0/3800426201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe2c80c9770 con 0x7fe2c814de70 2024-09-19T05:38:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2c77fe640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814de70 0x7fe2c8141db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8000c00 tx=0x7fe2b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800fea0 con 0x7fe2c814de70 2024-09-19T05:38:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7fe2b80133f0 con 0x7fe2c814de70 2024-09-19T05:38:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814de70 msgr2=0x7fe2c8141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2affff640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814de70 0x7fe2c8141db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8000c00 tx=0x7fe2b8000ed0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2affff640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814de70 msgr2=0x7fe2c8141db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.136+0000 7fe2affff640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c814de70 0x7fe2c8141db0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 8, 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 95269, 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:38:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:38:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:38:55.155 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:55.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe2b406c260 msgr2=0x7fe2b406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe2b406c260 0x7fe2b406e720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8153d90 tx=0x7fe2c00091f0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c81530a0 msgr2=0x7fe2c8144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 --2- 172.21.15.103:0/3800426201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2c81530a0 0x7fe2c8144090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc0046c0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2c7fff640 1 -- 172.21.15.103:0/3800426201 reap_dead start 2024-09-19T05:38:55.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2c7fff640 1 -- 172.21.15.103:0/3800426201 reap_dead start 2024-09-19T05:38:55.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 shutdown_connections 2024-09-19T05:38:55.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 >> 172.21.15.103:0/3800426201 conn(0x7fe2c806f910 msgr2=0x7fe2c80c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:55.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 shutdown_connections 2024-09-19T05:38:55.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.137+0000 7fe2cdb4b640 1 -- 172.21.15.103:0/3800426201 wait complete. 2024-09-19T05:38:55.160 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T05:38:55.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-19T05:38:55.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T05:38:55.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.265+0000 7ff334696640 1 Processor -- start 2024-09-19T05:38:55.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.265+0000 7ff334696640 1 -- start start 2024-09-19T05:38:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff334696640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 0x7ff32c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff334696640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32c0cbed0 con 0x7ff32c155040 2024-09-19T05:38:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff334696640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32c15bd70 con 0x7ff32c0c5950 2024-09-19T05:38:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff334696640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c0cbbf0 con 0x7ff32c0b3540 2024-09-19T05:38:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331c31640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 msgr2=0x7ff32c0cb540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff332432640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff32c155040 0x7ff32c15e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35072/0 (socket says 172.21.15.103:35072) 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff332432640 1 -- 172.21.15.103:0/1023204946 learned_addr learned my addr 172.21.15.103:0/1023204946 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331c31640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 0x7ff32c0cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418857609 0 0) 0x7ff32c0cbed0 con 0x7ff32c155040 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff318003520 con 0x7ff32c155040 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163927213 0 0) 0x7ff318003520 con 0x7ff32c155040 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 msgr2=0x7ff32c0cb540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 0x7ff32c0cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 >> v1:172.21.15.174:6789/0 conn(0x7ff32c0c5950 legacy=0x7ff32c0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c15afb0 con 0x7ff32c155040 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7ff328001670 con 0x7ff32c155040 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 >> v1:172.21.15.103:6789/0 conn(0x7ff32c155040 legacy=0x7ff32c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff318003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.266+0000 7ff331430640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff318004800 0x7ff318004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff331430640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 0x7ff318005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c0cbbf0 con 0x7ff3180039e0 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff31800bb50 con 0x7ff318004800 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff31800bd50 con 0x7ff32c0b3540 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332432640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff318003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332c33640 1 -- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 msgr2=0x7ff318005220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332c33640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 0x7ff318005220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff331c31640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff318004800 0x7ff318004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332432640 1 -- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 msgr2=0x7ff318005220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332432640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c0b3540 0x7ff318005220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332432640 1 -- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff318004800 msgr2=0x7ff318004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:38:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332432640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff318004800 0x7ff318004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.267+0000 7ff332432640 1 -- 172.21.15.103:0/1023204946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff318003520 con 0x7ff3180039e0 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff332432640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff318003dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c210 tx=0x7ff318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69bb522b6b6b1be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328007d10 con 0x7ff3180039e0 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3280058d0 con 0x7ff3180039e0 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff331430640 1 -- 172.21.15.103:0/1023204946 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328005ca0 con 0x7ff3180039e0 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff334696640 1 -- 172.21.15.103:0/1023204946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 msgr2=0x7ff318003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff334696640 1 --2- 172.21.15.103:0/1023204946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff318003dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c210 tx=0x7ff318005830 comp rx=0 tx=0).stop 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff332c33640 1 -- 172.21.15.103:0/1023204946 reap_dead start 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff334696640 1 -- 172.21.15.103:0/1023204946 shutdown_connections 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff334696640 1 -- 172.21.15.103:0/1023204946 >> 172.21.15.103:0/1023204946 conn(0x7ff32c073340 msgr2=0x7ff32c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff334696640 1 -- 172.21.15.103:0/1023204946 shutdown_connections 2024-09-19T05:38:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.268+0000 7ff334696640 1 -- 172.21.15.103:0/1023204946 wait complete. 2024-09-19T05:38:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 Processor -- start 2024-09-19T05:38:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 -- start start 2024-09-19T05:38:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff32c0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c15a510 0x7ff32c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c14b410 0x7ff32c14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c15b850 con 0x7ff3180039e0 2024-09-19T05:38:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c15b570 con 0x7ff32c14b410 2024-09-19T05:38:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff334696640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c15eb30 con 0x7ff32c15a510 2024-09-19T05:38:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff332432640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff32c0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff332432640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff32c0b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59502/0 (socket says 172.21.15.103:59502) 2024-09-19T05:38:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff332432640 1 -- 172.21.15.103:0/408632562 learned_addr learned my addr 172.21.15.103:0/408632562 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:38:55.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.270+0000 7ff331c31640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c15a510 msgr2=0x7ff32c0cfa70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:38:55.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff331c31640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c15a510 0x7ff32c0cfa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:38:55.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332c33640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c14b410 0x7ff32c14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332432640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c15a510 msgr2=0x7ff32c0cfa70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:38:55.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332432640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff32c15a510 0x7ff32c0cfa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332432640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c14b410 msgr2=0x7ff32c14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332432640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c14b410 0x7ff32c14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332432640 1 -- 172.21.15.103:0/408632562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c1f4a60 con 0x7ff3180039e0 2024-09-19T05:38:55.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332c33640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c14b410 0x7ff32c14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:38:55.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff332432640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff32c0b62d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c330 tx=0x7ff32c0b4770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328038040 con 0x7ff3180039e0 2024-09-19T05:38:55.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff328042070 con 0x7ff3180039e0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328001c40 con 0x7ff3180039e0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c1f4d40 con 0x7ff3180039e0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.271+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1f5300 con 0x7ff3180039e0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.272+0000 7ff334696640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c1f17f0 0x7ff32c1f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.272+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1e4430 con 0x7ff32c1f17f0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.272+0000 7ff331c31640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c1f17f0 0x7ff32c1f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.273+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff3280047e0 con 0x7ff3180039e0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.273+0000 7ff331c31640 1 -- 172.21.15.103:0/408632562 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff32c1f4810 con 0x7ff32c1f17f0 2024-09-19T05:38:55.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.273+0000 7ff322ffd640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff31006c260 0x7ff31006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.273+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff3280ab950 con 0x7ff3180039e0 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.273+0000 7ff331c31640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c1f17f0 0x7ff32c1f1c10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff31c003930 tx=0x7ff31c00d8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.273+0000 7ff332c33640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff31006c260 0x7ff31006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.273+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c003bc0 con 0x7ff32c1f17f0 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.274+0000 7ff332c33640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff31006c260 0x7ff31006e720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff32c068390 tx=0x7ff324009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.274+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff31c017070 con 0x7ff32c1f17f0 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.274+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c1f17f0 msgr2=0x7ff32c1f1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.274+0000 7ff322ffd640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c1f17f0 0x7ff32c1f1c10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff31c003930 tx=0x7ff31c00d8b0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.274+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c1f17f0 msgr2=0x7ff32c1f1c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:55.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.274+0000 7ff322ffd640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c1f17f0 0x7ff32c1f1c10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:55.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.280+0000 7ff334696640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c15c6c0 0x7ff32c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.280+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c153640 con 0x7ff32c15c6c0 2024-09-19T05:38:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.280+0000 7ff331c31640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c15c6c0 0x7ff32c15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.281+0000 7ff331c31640 1 -- 172.21.15.103:0/408632562 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff32c158850 con 0x7ff32c15c6c0 2024-09-19T05:38:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.281+0000 7ff331c31640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c15c6c0 0x7ff32c15caa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff31c003930 tx=0x7ff31c005a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.281+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0052e0 con 0x7ff32c15c6c0 2024-09-19T05:38:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.281+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5041 (secure 0 0 0) 0x7ff31c0052e0 con 0x7ff32c15c6c0 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c15c6c0 msgr2=0x7ff32c15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff322ffd640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c15c6c0 0x7ff32c15caa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff31c003930 tx=0x7ff31c005a80 comp rx=0 tx=0).stop 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff322ffd640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c15c6c0 msgr2=0x7ff32c15caa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff322ffd640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff32c15c6c0 0x7ff32c15caa0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff31c003930 tx=0x7ff31c005a80 comp rx=0 tx=0).stop 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 8, 2024-09-19T05:38:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 95374, 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:38:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:38:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:38:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:38:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:38:55.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:38:55.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:55.300 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.301 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:38:55.302 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:38:55.303 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:38:55.303 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:38:55.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:38:55.303 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:38:55.303 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:38:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff31006c260 msgr2=0x7ff31006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff31006c260 0x7ff31006e720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff32c068390 tx=0x7ff324009040 comp rx=0 tx=0).stop 2024-09-19T05:38:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 msgr2=0x7ff32c0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 --2- 172.21.15.103:0/408632562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3180039e0 0x7ff32c0b62d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c330 tx=0x7ff32c0b4770 comp rx=0 tx=0).stop 2024-09-19T05:38:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff332c33640 1 -- 172.21.15.103:0/408632562 reap_dead start 2024-09-19T05:38:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff332c33640 1 -- 172.21.15.103:0/408632562 reap_dead start 2024-09-19T05:38:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 shutdown_connections 2024-09-19T05:38:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 >> 172.21.15.103:0/408632562 conn(0x7ff32c073340 msgr2=0x7ff32c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 shutdown_connections 2024-09-19T05:38:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:38:55.282+0000 7ff334696640 1 -- 172.21.15.103:0/408632562 wait complete. 2024-09-19T05:38:55.306 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T05:38:55.306 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T05:39:12.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:12.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:15.306 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-19T05:39:15.307 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-19T05:39:15.307 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T05:39:15.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T05:39:15.310 INFO:tasks.ceph.mon.c:Started 2024-09-19T05:39:15.310 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T05:39:15.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:39:15.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.411+0000 7f9e740f1640 1 Processor -- start 2024-09-19T05:39:15.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.412+0000 7f9e740f1640 1 -- start start 2024-09-19T05:39:15.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.412+0000 7f9e740f1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c155040 0x7f9e6c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.412+0000 7f9e740f1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9e6c0c5950 0x7f9e6c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.412+0000 7f9e740f1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c0cbed0 con 0x7f9e6c0b3540 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.412+0000 7f9e740f1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6c15bd70 con 0x7f9e6c0c5950 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e740f1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0cbbf0 con 0x7f9e6c155040 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e71e8d640 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c155040 msgr2=0x7f9e6c0cb540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e71e8d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c155040 0x7f9e6c0cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e7268e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9e6c0c5950 0x7f9e6c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e7268e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9e6c0c5950 0x7f9e6c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54302/0 (socket says 172.21.15.103:54302) 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e7268e640 1 -- 172.21.15.103:0/185043783 learned_addr learned my addr 172.21.15.103:0/185043783 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e7268e640 1 -- 172.21.15.103:0/185043783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c155040 msgr2=0x7f9e6c0cb540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e7268e640 1 --2- 172.21.15.103:0/185043783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c155040 0x7f9e6c0cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e7268e640 1 -- 172.21.15.103:0/185043783 >> v1:172.21.15.174:6789/0 conn(0x7f9e6c0b3540 legacy=0x7f9e6c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.413+0000 7f9e7268e640 1 -- 172.21.15.103:0/185043783 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c15afb0 con 0x7f9e6c0c5950 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.414+0000 7f9e7268e640 1 --2- 172.21.15.103:0/185043783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c0cc2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009e50 tx=0x7f9e6402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ac1503e67f7917 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.414+0000 7f9e70e8b640 1 -- 172.21.15.103:0/185043783 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64036070 con 0x7f9e6c0c5950 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.414+0000 7f9e70e8b640 1 -- 172.21.15.103:0/185043783 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e64031600 con 0x7f9e6c0c5950 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.414+0000 7f9e70e8b640 1 -- 172.21.15.103:0/185043783 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e640319d0 con 0x7f9e6c0c5950 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 -- 172.21.15.103:0/185043783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c0c5950 msgr2=0x7f9e6c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 --2- 172.21.15.103:0/185043783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c0cc2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009e50 tx=0x7f9e6402a730 comp rx=0 tx=0).stop 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 -- 172.21.15.103:0/185043783 shutdown_connections 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 --2- 172.21.15.103:0/185043783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c0cc2c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 --2- 172.21.15.103:0/185043783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c155040 0x7f9e6c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 -- 172.21.15.103:0/185043783 >> 172.21.15.103:0/185043783 conn(0x7f9e6c073340 msgr2=0x7f9e6c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:15.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 -- 172.21.15.103:0/185043783 shutdown_connections 2024-09-19T05:39:15.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.415+0000 7f9e740f1640 1 -- 172.21.15.103:0/185043783 wait complete. 2024-09-19T05:39:15.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.416+0000 7f9e740f1640 1 Processor -- start 2024-09-19T05:39:15.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.416+0000 7f9e740f1640 1 -- start start 2024-09-19T05:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e740f1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c0b3540 0x7f9e6c0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e740f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e740f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c155040 0x7f9e6c14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e740f1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c15b850 con 0x7f9e6c155040 2024-09-19T05:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e740f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c15b570 con 0x7f9e6c0c5950 2024-09-19T05:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e740f1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c15eb30 con 0x7f9e6c0b3540 2024-09-19T05:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e7168c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e7268e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c155040 0x7f9e6c14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.417+0000 7f9e7168c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c14f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:50426/0 (socket says 172.21.15.103:50426) 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7168c640 1 -- 172.21.15.103:0/3458448545 learned_addr learned my addr 172.21.15.103:0/3458448545 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7268e640 1 -- 172.21.15.103:0/3458448545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c0b3540 msgr2=0x7f9e6c0b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7268e640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c0b3540 0x7f9e6c0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7268e640 1 -- 172.21.15.103:0/3458448545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e6c0c5950 msgr2=0x7f9e6c14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7268e640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c14f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7268e640 1 -- 172.21.15.103:0/3458448545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c0b6330 con 0x7f9e6c155040 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7168c640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e7268e640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c155040 0x7f9e6c14d3c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9e64030000 tx=0x7f9e64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e627fc640 1 -- 172.21.15.103:0/3458448545 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64041020 con 0x7f9e6c155040 2024-09-19T05:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e627fc640 1 -- 172.21.15.103:0/3458448545 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e640077a0 con 0x7f9e6c155040 2024-09-19T05:39:15.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c0b6610 con 0x7f9e6c155040 2024-09-19T05:39:15.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e627fc640 1 -- 172.21.15.103:0/3458448545 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64036040 con 0x7f9e6c155040 2024-09-19T05:39:15.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.418+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c1f4b70 con 0x7f9e6c155040 2024-09-19T05:39:15.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.420+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c0cb540 con 0x7f9e6c155040 2024-09-19T05:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.420+0000 7f9e627fc640 1 -- 172.21.15.103:0/3458448545 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e64044020 con 0x7f9e6c155040 2024-09-19T05:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.421+0000 7f9e627fc640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9e5006c2e0 0x7f9e5006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.421+0000 7f9e627fc640 1 -- 172.21.15.103:0/3458448545 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9e640ac3f0 con 0x7f9e6c155040 2024-09-19T05:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.421+0000 7f9e71e8d640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9e5006c2e0 0x7f9e5006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.421+0000 7f9e71e8d640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9e5006c2e0 0x7f9e5006e7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e68003930 tx=0x7f9e68006cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.425+0000 7f9e627fc640 1 -- 172.21.15.103:0/3458448545 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9e6404b030 con 0x7f9e6c155040 2024-09-19T05:39:15.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.772+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9e6c069380 con 0x7f9e6c155040 2024-09-19T05:39:15.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.773+0000 7f9e627fc640 1 -- 172.21.15.103:0/3458448545 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f9e6407a810 con 0x7f9e6c155040 2024-09-19T05:39:15.774 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:39:15.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9e5006c2e0 msgr2=0x7f9e5006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9e5006c2e0 0x7f9e5006e7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e68003930 tx=0x7f9e68006cf0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c155040 msgr2=0x7f9e6c14d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c155040 0x7f9e6c14d3c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9e64030000 tx=0x7f9e64004a40 comp rx=0 tx=0).stop 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 shutdown_connections 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9e5006c2e0 0x7f9e5006e7a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e6c155040 0x7f9e6c14d3c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e6c0c5950 0x7f9e6c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 --2- 172.21.15.103:0/3458448545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6c0b3540 0x7f9e6c0b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 >> 172.21.15.103:0/3458448545 conn(0x7f9e6c073340 msgr2=0x7f9e6c073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 shutdown_connections 2024-09-19T05:39:15.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.776+0000 7f9e740f1640 1 -- 172.21.15.103:0/3458448545 wait complete. 2024-09-19T05:39:15.793 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T05:39:15.793 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T05:39:15.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T05:39:15.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.920+0000 7fb15f39f640 1 Processor -- start 2024-09-19T05:39:15.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.920+0000 7fb15f39f640 1 -- start start 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15f39f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb158151f80 0x7fb158158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15f39f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1580cce80 0x7fb158158f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15f39f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 0x7fb1580701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15f39f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb1580cc620 con 0x7fb1580cce80 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15f39f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fb158158a50 con 0x7fb158151f80 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15f39f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb1580cc0f0 con 0x7fb15806fd70 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15c93a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1580cce80 0x7fb158158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15c93a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1580cce80 0x7fb158158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54318/0 (socket says 172.21.15.103:54318) 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15c93a640 1 -- 172.21.15.103:0/2577913482 learned_addr learned my addr 172.21.15.103:0/2577913482 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:15.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15d93c640 1 --2- 172.21.15.103:0/2577913482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 0x7fb1580701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15d13b640 1 --2- 172.21.15.103:0/2577913482 >> v2:172.21.15.174:3300/0 conn(0x7fb158151f80 0x7fb158158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15c93a640 1 -- 172.21.15.103:0/2577913482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 msgr2=0x7fb1580701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15c93a640 1 --2- 172.21.15.103:0/2577913482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 0x7fb1580701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15c93a640 1 -- 172.21.15.103:0/2577913482 >> v2:172.21.15.174:3300/0 conn(0x7fb158151f80 msgr2=0x7fb158158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.921+0000 7fb15c93a640 1 --2- 172.21.15.103:0/2577913482 >> v2:172.21.15.174:3300/0 conn(0x7fb158151f80 0x7fb158158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.922+0000 7fb15c93a640 1 -- 172.21.15.103:0/2577913482 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15815b1b0 con 0x7fb1580cce80 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.922+0000 7fb15d13b640 1 --2- 172.21.15.103:0/2577913482 >> v2:172.21.15.174:3300/0 conn(0x7fb158151f80 0x7fb158158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.922+0000 7fb15c93a640 1 --2- 172.21.15.103:0/2577913482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb158158f80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb1580cb0b0 tx=0x7fb14802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d5c122539fd70a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.922+0000 7fb14ffff640 1 -- 172.21.15.103:0/2577913482 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148037070 con 0x7fb1580cce80 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.922+0000 7fb14ffff640 1 -- 172.21.15.103:0/2577913482 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb148032440 con 0x7fb1580cce80 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb14ffff640 1 -- 172.21.15.103:0/2577913482 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148032810 con 0x7fb1580cce80 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 -- 172.21.15.103:0/2577913482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 msgr2=0x7fb158158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 --2- 172.21.15.103:0/2577913482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb158158f80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb1580cb0b0 tx=0x7fb14802a1e0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 -- 172.21.15.103:0/2577913482 shutdown_connections 2024-09-19T05:39:15.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 --2- 172.21.15.103:0/2577913482 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 0x7fb1580701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 --2- 172.21.15.103:0/2577913482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb158158f80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 --2- 172.21.15.103:0/2577913482 >> v2:172.21.15.174:3300/0 conn(0x7fb158151f80 0x7fb158158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 -- 172.21.15.103:0/2577913482 >> 172.21.15.103:0/2577913482 conn(0x7fb1580cd570 msgr2=0x7fb1580cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:15.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.923+0000 7fb15f39f640 1 -- 172.21.15.103:0/2577913482 shutdown_connections 2024-09-19T05:39:15.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.924+0000 7fb15f39f640 1 -- 172.21.15.103:0/2577913482 wait complete. 2024-09-19T05:39:15.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.925+0000 7fb15f39f640 1 Processor -- start 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.925+0000 7fb15f39f640 1 -- start start 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.926+0000 7fb15f39f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 0x7fb158152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.926+0000 7fb15f39f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb15815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15f39f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb158151f80 0x7fb1581efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb15815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb15815a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54320/0 (socket says 172.21.15.103:54320) 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 -- 172.21.15.103:0/1864644451 learned_addr learned my addr 172.21.15.103:0/1864644451 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb15815b730 con 0x7fb1580cce80 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb15815b450 con 0x7fb158151f80 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb15815ba10 con 0x7fb15806fd70 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15d13b640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 0x7fb158152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15d93c640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb158151f80 0x7fb1581efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 msgr2=0x7fb158152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb15806fd70 0x7fb158152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb158151f80 msgr2=0x7fb1581efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb158151f80 0x7fb1581efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1581f07a0 con 0x7fb1580cce80 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb15c93a640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb15815a290 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb14802a220 tx=0x7fb1480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.927+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148041020 con 0x7fb1580cce80 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.928+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1480306c0 con 0x7fb1580cce80 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.928+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148037040 con 0x7fb1580cce80 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.928+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb158073e10 con 0x7fb1580cce80 2024-09-19T05:39:15.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.928+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1580743d0 con 0x7fb1580cce80 2024-09-19T05:39:15.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.929+0000 7fb15f39f640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158155bb0 0x7fb1581f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.929+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581553b0 con 0x7fb158155bb0 2024-09-19T05:39:15.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.929+0000 7fb15d13b640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158155bb0 0x7fb1581f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.929+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb148044020 con 0x7fb1580cce80 2024-09-19T05:39:15.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.929+0000 7fb15d13b640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1580c8090 con 0x7fb158155bb0 2024-09-19T05:39:15.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb15d13b640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158155bb0 0x7fb1581f0120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bfa0 tx=0x7fb154010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb13c06c2b0 0x7fb13c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb1480ac130 con 0x7fb1580cce80 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb15d93c640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb13c06c2b0 0x7fb13c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154004220 con 0x7fb158155bb0 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb1540043c0 con 0x7fb158155bb0 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158155bb0 msgr2=0x7fb1581f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158155bb0 0x7fb1581f0120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bfa0 tx=0x7fb154010850 comp rx=0 tx=0).stop 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158155bb0 msgr2=0x7fb1581f0120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.930+0000 7fb14dffb640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158155bb0 0x7fb1581f0120 secure :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bfa0 tx=0x7fb154010850 comp rx=0 tx=0).stop 2024-09-19T05:39:15.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.931+0000 7fb15d93c640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb13c06c2b0 0x7fb13c06e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb150009430 tx=0x7fb15000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.937+0000 7fb15f39f640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158156340 0x7fb158156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:15.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.937+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb158156100 con 0x7fb158156340 2024-09-19T05:39:15.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.937+0000 7fb15d13b640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158156340 0x7fb158156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:15.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.937+0000 7fb15d13b640 1 -- 172.21.15.103:0/1864644451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb1580cbaf0 con 0x7fb158156340 2024-09-19T05:39:15.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb15d13b640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158156340 0x7fb158156720 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bfa0 tx=0x7fb1540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:15.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154029070 con 0x7fb158156340 2024-09-19T05:39:15.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7fb154003e40 con 0x7fb158156340 2024-09-19T05:39:15.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158156340 msgr2=0x7fb158156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb14dffb640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158156340 0x7fb158156720 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bfa0 tx=0x7fb1540046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb14dffb640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158156340 msgr2=0x7fb158156720 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:15.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb14dffb640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb158156340 0x7fb158156720 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bfa0 tx=0x7fb1540046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 116070, 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:15.941 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:15.942 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:15.943 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:15.944 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:15.945 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:15.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:15.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:15.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:15.949 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:15.950 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:15.952 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:39:15.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:15.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:15.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:15.956 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:15.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:15.956 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb13c06c2b0 msgr2=0x7fb13c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.938+0000 7fb15f39f640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb13c06c2b0 0x7fb13c06e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb150009430 tx=0x7fb15000b040 comp rx=0 tx=0).stop 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 msgr2=0x7fb15815a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15f39f640 1 --2- 172.21.15.103:0/1864644451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1580cce80 0x7fb15815a290 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb14802a220 tx=0x7fb1480046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15d93c640 1 -- 172.21.15.103:0/1864644451 reap_dead start 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15d93c640 1 -- 172.21.15.103:0/1864644451 reap_dead start 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 shutdown_connections 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 >> 172.21.15.103:0/1864644451 conn(0x7fb1580cd570 msgr2=0x7fb15814d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 shutdown_connections 2024-09-19T05:39:15.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:15.939+0000 7fb15f39f640 1 -- 172.21.15.103:0/1864644451 wait complete. 2024-09-19T05:39:15.959 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:39:15.959 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T05:39:15.959 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.064+0000 7fdd54352640 1 Processor -- start 2024-09-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.064+0000 7fdd54352640 1 -- start start 2024-09-19T05:39:16.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.065+0000 7fdd54352640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 0x7fdd4c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.065+0000 7fdd54352640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd4c0c5950 0x7fdd4c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.065+0000 7fdd54352640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c0cbed0 con 0x7fdd4c155040 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.065+0000 7fdd54352640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c15bd70 con 0x7fdd4c0c5950 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.065+0000 7fdd54352640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c0cbbf0 con 0x7fdd4c0b3540 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.065+0000 7fdd528ef640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd4c0c5950 0x7fdd4c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd520ee640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd4c155040 0x7fdd4c15e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:32832/0 (socket says 172.21.15.103:32832) 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd520ee640 1 -- 172.21.15.103:0/1272421150 learned_addr learned my addr 172.21.15.103:0/1272421150 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd528ef640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd4c0c5950 0x7fdd4c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54330/0 (socket says 172.21.15.103:54330) 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd518ed640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 0x7fdd4c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd518ed640 1 -- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 msgr2=0x7fdd4c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd518ed640 1 -- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 msgr2=0x7fdd4c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd518ed640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 0x7fdd4c0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd518ed640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 0x7fdd4c0cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd510ec640 1 -- 172.21.15.103:0/1272421150 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329841594 0 0) 0x7fdd4c0cbed0 con 0x7fdd4c155040 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd510ec640 1 -- 172.21.15.103:0/1272421150 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd38003520 con 0x7fdd4c155040 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd528ef640 1 -- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 msgr2=0x7fdd4c0cb540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd528ef640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 0x7fdd4c0cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd528ef640 1 -- 172.21.15.103:0/1272421150 >> v1:172.21.15.103:6789/0 conn(0x7fdd4c155040 legacy=0x7fdd4c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.066+0000 7fdd528ef640 1 -- 172.21.15.103:0/1272421150 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c15afb0 con 0x7fdd4c0c5950 2024-09-19T05:39:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.067+0000 7fdd528ef640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0c5950 0x7fdd4c0cc2c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009d90 tx=0x7fdd4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c98816fee526b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.067+0000 7fdd510ec640 1 -- 172.21.15.103:0/1272421150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44007740 con 0x7fdd4c0c5950 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.067+0000 7fdd510ec640 1 -- 172.21.15.103:0/1272421150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd440078e0 con 0x7fdd4c0c5950 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.067+0000 7fdd510ec640 1 -- 172.21.15.103:0/1272421150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44007c90 con 0x7fdd4c0c5950 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.068+0000 7fdd54352640 1 -- 172.21.15.103:0/1272421150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0c5950 msgr2=0x7fdd4c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.068+0000 7fdd54352640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0c5950 0x7fdd4c0cc2c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009d90 tx=0x7fdd4402a6f0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.068+0000 7fdd54352640 1 -- 172.21.15.103:0/1272421150 shutdown_connections 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.068+0000 7fdd54352640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0c5950 0x7fdd4c0cc2c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.068+0000 7fdd54352640 1 --2- 172.21.15.103:0/1272421150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0b3540 0x7fdd4c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.068+0000 7fdd54352640 1 -- 172.21.15.103:0/1272421150 >> 172.21.15.103:0/1272421150 conn(0x7fdd4c073340 msgr2=0x7fdd4c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.069+0000 7fdd54352640 1 -- 172.21.15.103:0/1272421150 shutdown_connections 2024-09-19T05:39:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.069+0000 7fdd54352640 1 -- 172.21.15.103:0/1272421150 wait complete. 2024-09-19T05:39:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.070+0000 7fdd54352640 1 Processor -- start 2024-09-19T05:39:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.070+0000 7fdd54352640 1 -- start start 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd54352640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0b3540 0x7fdd4c1e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd54352640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 0x7fdd4c1e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd54352640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c155040 0x7fdd4c1e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd54352640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c15b850 con 0x7fdd4c0b3540 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd54352640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c15b570 con 0x7fdd4c155040 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd54352640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c15eb30 con 0x7fdd4c0c5950 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0b3540 0x7fdd4c1e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0b3540 0x7fdd4c1e61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54344/0 (socket says 172.21.15.103:54344) 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 -- 172.21.15.103:0/2556913254 learned_addr learned my addr 172.21.15.103:0/2556913254 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd518ed640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 0x7fdd4c1e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd528ef640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c155040 0x7fdd4c1e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd518ed640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 msgr2=0x7fdd4c1e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd518ed640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 msgr2=0x7fdd4c1e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd518ed640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 0x7fdd4c1e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd518ed640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 0x7fdd4c1e6bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 msgr2=0x7fdd4c1e6bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd4c0c5950 0x7fdd4c1e6bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c155040 msgr2=0x7fdd4c1e4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c155040 0x7fdd4c1e4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.071+0000 7fdd520ee640 1 -- 172.21.15.103:0/2556913254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c158b10 con 0x7fdd4c0b3540 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.072+0000 7fdd520ee640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0b3540 0x7fdd4c1e61b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800c390 tx=0x7fdd4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.072+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48017070 con 0x7fdd4c0b3540 2024-09-19T05:39:16.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.072+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48005ce0 con 0x7fdd4c0b3540 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.072+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480072f0 con 0x7fdd4c0b3540 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.072+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c158df0 con 0x7fdd4c0b3540 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.072+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c1e4600 con 0x7fdd4c0b3540 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.073+0000 7fdd54352640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c0b6610 0x7fdd4c1e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.073+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0cb540 con 0x7fdd4c0b6610 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.073+0000 7fdd518ed640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c0b6610 0x7fdd4c1e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.074+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd4801a070 con 0x7fdd4c0b3540 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.074+0000 7fdd42ffd640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdd3006c2b0 0x7fdd3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.074+0000 7fdd518ed640 1 -- 172.21.15.103:0/2556913254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd4c069380 con 0x7fdd4c0b6610 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.075+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdd4808ad60 con 0x7fdd4c0b3540 2024-09-19T05:39:16.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.075+0000 7fdd528ef640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdd3006c2b0 0x7fdd3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.075+0000 7fdd518ed640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c0b6610 0x7fdd4c1e5060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0b4290 tx=0x7fdd3c00f910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.075+0000 7fdd528ef640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdd3006c2b0 0x7fdd3006e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd44034000 tx=0x7fdd4402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.075+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c019020 con 0x7fdd4c0b6610 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.076+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd3c014870 con 0x7fdd4c0b6610 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.076+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c0b6610 msgr2=0x7fdd4c1e5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.076+0000 7fdd42ffd640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c0b6610 0x7fdd4c1e5060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0b4290 tx=0x7fdd3c00f910 comp rx=0 tx=0).stop 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.076+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c0b6610 msgr2=0x7fdd4c1e5060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:16.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.076+0000 7fdd42ffd640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c0b6610 0x7fdd4c1e5060 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0b4290 tx=0x7fdd3c00f910 comp rx=0 tx=0).stop 2024-09-19T05:39:16.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.087+0000 7fdd54352640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c152f40 0x7fdd4c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.087+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0cac60 con 0x7fdd4c152f40 2024-09-19T05:39:16.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.088+0000 7fdd518ed640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c152f40 0x7fdd4c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.088+0000 7fdd518ed640 1 -- 172.21.15.103:0/2556913254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd4c0cc0a0 con 0x7fdd4c152f40 2024-09-19T05:39:16.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.088+0000 7fdd518ed640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c152f40 0x7fdd4c14c950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00bfd0 tx=0x7fdd3c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.088+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c019040 con 0x7fdd4c152f40 2024-09-19T05:39:16.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fdd3c01e420 con 0x7fdd4c152f40 2024-09-19T05:39:16.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c152f40 msgr2=0x7fdd4c14c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd42ffd640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c152f40 0x7fdd4c14c950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00bfd0 tx=0x7fdd3c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:16.092 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:16.092 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 116181, 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:16.093 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:16.094 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:16.095 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:16.096 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:16.097 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:16.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:16.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:16.102 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:16.103 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:16.104 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:16.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:16.106 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:16.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd42ffd640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c152f40 msgr2=0x7fdd4c14c950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd42ffd640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd4c152f40 0x7fdd4c14c950 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00bfd0 tx=0x7fdd3c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdd3006c2b0 msgr2=0x7fdd3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdd3006c2b0 0x7fdd3006e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd44034000 tx=0x7fdd4402f000 comp rx=0 tx=0).stop 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0b3540 msgr2=0x7fdd4c1e61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 --2- 172.21.15.103:0/2556913254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c0b3540 0x7fdd4c1e61b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800c390 tx=0x7fdd4800c850 comp rx=0 tx=0).stop 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd528ef640 1 -- 172.21.15.103:0/2556913254 reap_dead start 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd528ef640 1 -- 172.21.15.103:0/2556913254 reap_dead start 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 shutdown_connections 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 >> 172.21.15.103:0/2556913254 conn(0x7fdd4c073340 msgr2=0x7fdd4c154360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 shutdown_connections 2024-09-19T05:39:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.089+0000 7fdd54352640 1 -- 172.21.15.103:0/2556913254 wait complete. 2024-09-19T05:39:16.111 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:39:16.111 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T05:39:16.111 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T05:39:16.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.213+0000 7f0fad3f6640 1 Processor -- start 2024-09-19T05:39:16.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.213+0000 7f0fad3f6640 1 -- start start 2024-09-19T05:39:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fad3f6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0fa8155040 0x7f0fa80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fad3f6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 0x7f0fa815e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fad3f6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa80cbed0 con 0x7f0fa815e960 2024-09-19T05:39:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fad3f6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa815bd70 con 0x7f0fa8155040 2024-09-19T05:39:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fad3f6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa80cbbf0 con 0x7f0fa80b3540 2024-09-19T05:39:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa67fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 0x7f0fa815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa6ffd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0fa8155040 0x7f0fa80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa67fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 0x7f0fa815e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:38388/0 (socket says 172.21.15.103:38388) 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa77fe640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0fa815e960 0x7f0fa80cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:35268/0 (socket says 172.21.15.103:35268) 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa6ffd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0fa8155040 0x7f0fa80cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:50476/0 (socket says 172.21.15.103:50476) 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa67fc640 1 -- 172.21.15.103:0/3943581484 learned_addr learned my addr 172.21.15.103:0/3943581484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa67fc640 1 -- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 msgr2=0x7f0fa815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa67fc640 1 -- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 msgr2=0x7f0fa815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa67fc640 1 --2- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 0x7f0fa815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa67fc640 1 --2- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 0x7f0fa815e420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 msgr2=0x7f0fa815e420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 0x7f0fa815e420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3943581484 >> v1:172.21.15.174:6789/0 conn(0x7f0fa815e960 legacy=0x7f0fa80cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.214+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3943581484 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa815afb0 con 0x7f0fa8155040 2024-09-19T05:39:16.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.215+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa8155040 0x7f0fa80cb540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f980097a0 tx=0x7f0f9802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed3a249f53b9852 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.215+0000 7f0fa5ffb640 1 -- 172.21.15.103:0/3943581484 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98037070 con 0x7f0fa8155040 2024-09-19T05:39:16.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.215+0000 7f0fa5ffb640 1 -- 172.21.15.103:0/3943581484 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f98032440 con 0x7f0fa8155040 2024-09-19T05:39:16.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.215+0000 7f0fa5ffb640 1 -- 172.21.15.103:0/3943581484 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98032810 con 0x7f0fa8155040 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 -- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa8155040 msgr2=0x7f0fa80cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 --2- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa8155040 0x7f0fa80cb540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f980097a0 tx=0x7f0f9802a210 comp rx=0 tx=0).stop 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 -- 172.21.15.103:0/3943581484 shutdown_connections 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 --2- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80b3540 0x7f0fa815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 --2- 172.21.15.103:0/3943581484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa8155040 0x7f0fa80cb540 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 -- 172.21.15.103:0/3943581484 >> 172.21.15.103:0/3943581484 conn(0x7f0fa8073340 msgr2=0x7f0fa8073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 -- 172.21.15.103:0/3943581484 shutdown_connections 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.216+0000 7f0fad3f6640 1 -- 172.21.15.103:0/3943581484 wait complete. 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.217+0000 7f0fad3f6640 1 Processor -- start 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.217+0000 7f0fad3f6640 1 -- start start 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fad3f6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa80b3540 0x7f0fa80c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fad3f6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 0x7f0fa80b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fad3f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa815e960 0x7f0fa80c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fad3f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa815b850 con 0x7f0fa815e960 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fad3f6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa815b570 con 0x7f0fa80b3540 2024-09-19T05:39:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fad3f6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa80cc9d0 con 0x7f0fa8155040 2024-09-19T05:39:16.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fa77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa815e960 0x7f0fa80c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fa77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa815e960 0x7f0fa80c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54346/0 (socket says 172.21.15.103:54346) 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fa77fe640 1 -- 172.21.15.103:0/3335839486 learned_addr learned my addr 172.21.15.103:0/3335839486 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa80b3540 0x7f0fa80c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.218+0000 7f0fa67fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 0x7f0fa80b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa67fc640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 msgr2=0x7f0fa80b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa67fc640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 msgr2=0x7f0fa80b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa67fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 0x7f0fa80b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa67fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 0x7f0fa80b5a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa77fe640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 msgr2=0x7f0fa80b5a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa77fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa8155040 0x7f0fa80b5a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa77fe640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa80b3540 msgr2=0x7f0fa80c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa77fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa80b3540 0x7f0fa80c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa77fe640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa815ab20 con 0x7f0fa815e960 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa80b3540 0x7f0fa80c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fa77fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa815e960 0x7f0fa80c8080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c760 tx=0x7f0fa000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0017070 con 0x7f0fa815e960 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa000a640 con 0x7f0fa815e960 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fad3f6640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa80c6bd0 con 0x7f0fa815e960 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000a9f0 con 0x7f0fa815e960 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.219+0000 7f0fad3f6640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa8153b70 con 0x7f0fa815e960 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.221+0000 7f0f8d7fa640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.221+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0f80007ec0 con 0x7f0f80002a70 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.221+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.221+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.221+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.221+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.221+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.222+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0fa001a070 con 0x7f0fa815e960 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.222+0000 7f0f8f7fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0f9406c2e0 0x7f0f9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.222+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f0fa008ad00 con 0x7f0fa815e960 2024-09-19T05:39:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.222+0000 7f0fa67fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0f9406c2e0 0x7f0f9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.223+0000 7f0fa67fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0f9406c2e0 0x7f0f9406e7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80cc8f0 tx=0x7f0f9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.422+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.422+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:39:16.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.422+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:16.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.422+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:16.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.422+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:39:16.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.823+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.823+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:39:16.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.823+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:16.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.823+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:16.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:16.823+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:39:17.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:17.624+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:17.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:17.624+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:39:17.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:17.624+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:17.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:17.624+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:17.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:17.624+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:39:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:19.225+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:19.225+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:39:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:19.225+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:19.225+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:19.225+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-19T05:39:20.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.217+0000 7f0f8e7fc640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:20.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.217+0000 7f0f8e7fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.217+0000 7f0f8e7fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.217+0000 7f0f8e7fc640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 msgr2=0x7f0f80004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:20.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.217+0000 7f0f8e7fc640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80002a70 0x7f0f80004f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.217+0000 7f0f8e7fc640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0f80007ec0 con 0x7f0fa80c85c0 2024-09-19T05:39:20.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.218+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.218+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 msgr2=0x7f0fa814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:39:20.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.218+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 msgr2=0x7f0fa814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:20.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.218+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:20.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.218+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:20.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.419+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.419+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 msgr2=0x7f0fa814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:39:20.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.419+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 msgr2=0x7f0fa814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:39:20.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.419+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:20.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.419+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:39:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.820+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.820+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fa806cfc0 con 0x7f0fa80c85c0 2024-09-19T05:39:20.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.821+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80c5f50 tx=0x7f0f980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.821+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98048020 con 0x7f0fa80c85c0 2024-09-19T05:39:20.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.821+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0f9803cb20 con 0x7f0fa80c85c0 2024-09-19T05:39:20.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.821+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 msgr2=0x7f0fa814c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.821+0000 7f0f8f7fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80c5f50 tx=0x7f0f980046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.821+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 msgr2=0x7f0fa814c080 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:20.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.821+0000 7f0f8f7fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa80c85c0 0x7f0fa814c080 secure :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80c5f50 tx=0x7f0f980046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.833+0000 7f0f8d7fa640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80006f30 0x7f0f800073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.833+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8000a400 con 0x7f0f80006f30 2024-09-19T05:39:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.834+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80006f30 0x7f0f800073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.834+0000 7f0fa6ffd640 1 -- 172.21.15.103:0/3335839486 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f800078e0 con 0x7f0f80006f30 2024-09-19T05:39:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.834+0000 7f0fa6ffd640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80006f30 0x7f0f800073a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80699f0 tx=0x7f0f9803e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.834+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98048040 con 0x7f0f80006f30 2024-09-19T05:39:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f0f98056420 con 0x7f0f80006f30 2024-09-19T05:39:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80006f30 msgr2=0x7f0f800073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8f7fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80006f30 0x7f0f800073a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80699f0 tx=0x7f0f9803e040 comp rx=0 tx=0).stop 2024-09-19T05:39:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8f7fe640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80006f30 msgr2=0x7f0f800073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8f7fe640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f80006f30 0x7f0f800073a0 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80699f0 tx=0x7f0f9803e040 comp rx=0 tx=0).stop 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0fa77fe640 1 -- 172.21.15.103:0/3335839486 reap_dead start 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 5423, 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:20.838 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 5, 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:20.839 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:20.840 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:20.841 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:20.846 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:20.847 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:20.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:20.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:20.850 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:20.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:20.850 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:20.850 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:20.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0f9406c2e0 msgr2=0x7f0f9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0f9406c2e0 0x7f0f9406e7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80cc8f0 tx=0x7f0f9c008040 comp rx=0 tx=0).stop 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa815e960 msgr2=0x7f0fa80c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa815e960 0x7f0fa80c8080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c760 tx=0x7f0fa000cc20 comp rx=0 tx=0).stop 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 shutdown_connections 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0f9406c2e0 0x7f0f9406e7a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 --2- 172.21.15.103:0/3335839486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa815e960 0x7f0fa80c8080 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.835+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 >> 172.21.15.103:0/3335839486 conn(0x7f0fa8073340 msgr2=0x7f0fa806c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.836+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 shutdown_connections 2024-09-19T05:39:20.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.836+0000 7f0f8d7fa640 1 -- 172.21.15.103:0/3335839486 wait complete. 2024-09-19T05:39:20.852 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:39:20.852 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T05:39:20.853 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T05:39:20.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.974+0000 7f3092f91640 1 Processor -- start 2024-09-19T05:39:20.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.975+0000 7f3092f91640 1 -- start start 2024-09-19T05:39:20.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.975+0000 7f3092f91640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c159420 0x7f308c071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.975+0000 7f3092f91640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f308c0ca040 0x7f308c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.975+0000 7f3092f91640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308c0cf460 con 0x7f308c071660 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.975+0000 7f3092f91640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f308c0c94a0 con 0x7f308c0ca040 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.975+0000 7f3092f91640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f308c15f430 con 0x7f308c159420 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f309152e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f308c0ca040 0x7f308c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f309152e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f308c0ca040 0x7f308c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54348/0 (socket says 172.21.15.103:54348) 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f309152e640 1 -- 172.21.15.103:0/2963451497 learned_addr learned my addr 172.21.15.103:0/2963451497 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f3090d2d640 1 --2- 172.21.15.103:0/2963451497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c159420 0x7f308c071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f309152e640 1 -- 172.21.15.103:0/2963451497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c159420 msgr2=0x7f308c071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f309152e640 1 --2- 172.21.15.103:0/2963451497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c159420 0x7f308c071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f309152e640 1 -- 172.21.15.103:0/2963451497 >> v1:172.21.15.174:6789/0 conn(0x7f308c071660 legacy=0x7f308c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.976+0000 7f309152e640 1 -- 172.21.15.103:0/2963451497 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c15f710 con 0x7f308c0ca040 2024-09-19T05:39:20.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.977+0000 7f309152e640 1 --2- 172.21.15.103:0/2963451497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c0ca040 0x7f308c06cd20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3084009e50 tx=0x7f308402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1390e5e14d852d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.977+0000 7f308b7fe640 1 -- 172.21.15.103:0/2963451497 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084036070 con 0x7f308c0ca040 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.977+0000 7f308b7fe640 1 -- 172.21.15.103:0/2963451497 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3084031600 con 0x7f308c0ca040 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.977+0000 7f308b7fe640 1 -- 172.21.15.103:0/2963451497 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30840319d0 con 0x7f308c0ca040 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 -- 172.21.15.103:0/2963451497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c0ca040 msgr2=0x7f308c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 --2- 172.21.15.103:0/2963451497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c0ca040 0x7f308c06cd20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3084009e50 tx=0x7f308402a710 comp rx=0 tx=0).stop 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 -- 172.21.15.103:0/2963451497 shutdown_connections 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 --2- 172.21.15.103:0/2963451497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c0ca040 0x7f308c06cd20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 --2- 172.21.15.103:0/2963451497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c159420 0x7f308c071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 -- 172.21.15.103:0/2963451497 >> 172.21.15.103:0/2963451497 conn(0x7f308c06f910 msgr2=0x7f308c0735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 -- 172.21.15.103:0/2963451497 shutdown_connections 2024-09-19T05:39:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.978+0000 7f3092f91640 1 -- 172.21.15.103:0/2963451497 wait complete. 2024-09-19T05:39:20.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.979+0000 7f3092f91640 1 Processor -- start 2024-09-19T05:39:20.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.979+0000 7f3092f91640 1 -- start start 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f3092f91640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c071660 0x7f308c0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f3092f91640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f308c0ca040 0x7f308c15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f3092f91640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c159420 0x7f308c15e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f3092f91640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f308c15ffb0 con 0x7f308c159420 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f3092f91640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f308c15fcd0 con 0x7f308c0ca040 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f3092f91640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f308c159800 con 0x7f308c071660 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f309152e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c159420 0x7f308c15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f308bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f308c0ca040 0x7f308c15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f309152e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c159420 0x7f308c15e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54356/0 (socket says 172.21.15.103:54356) 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f309152e640 1 -- 172.21.15.103:0/3482282253 learned_addr learned my addr 172.21.15.103:0/3482282253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:20.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.980+0000 7f3090d2d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c071660 0x7f308c0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f3090d2d640 1 -- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f308c0ca040 msgr2=0x7f308c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f3090d2d640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f308c0ca040 0x7f308c15dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f3090d2d640 1 -- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c159420 msgr2=0x7f308c15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f3090d2d640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c159420 0x7f308c15e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f3090d2d640 1 -- 172.21.15.103:0/3482282253 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c1f55f0 con 0x7f308c071660 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f309152e640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c159420 0x7f308c15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f308bfff640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f308c0ca040 0x7f308c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f3090d2d640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c071660 0x7f308c0c7740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f308000e870 tx=0x7f308000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f30897fa640 1 -- 172.21.15.103:0/3482282253 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080017070 con 0x7f308c071660 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f30897fa640 1 -- 172.21.15.103:0/3482282253 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308000ee60 con 0x7f308c071660 2024-09-19T05:39:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.981+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308c1f58b0 con 0x7f308c071660 2024-09-19T05:39:20.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.982+0000 7f30897fa640 1 -- 172.21.15.103:0/3482282253 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308000cb60 con 0x7f308c071660 2024-09-19T05:39:20.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.982+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f308c15d200 con 0x7f308c071660 2024-09-19T05:39:20.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.983+0000 7f30897fa640 1 -- 172.21.15.103:0/3482282253 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f308001a070 con 0x7f308c071660 2024-09-19T05:39:20.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.983+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f308c071120 con 0x7f308c071660 2024-09-19T05:39:20.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.984+0000 7f30897fa640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f307006c2b0 0x7f307006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:20.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.984+0000 7f30897fa640 1 -- 172.21.15.103:0/3482282253 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f308008afa0 con 0x7f308c071660 2024-09-19T05:39:20.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.984+0000 7f308bfff640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f307006c2b0 0x7f307006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:20.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.985+0000 7f308bfff640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f307006c2b0 0x7f307006e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f308c1e8a60 tx=0x7f3078009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:20.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:20.989+0000 7f30897fa640 1 -- 172.21.15.103:0/3482282253 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3080058cb0 con 0x7f308c071660 2024-09-19T05:39:21.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.330+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f308c069380 con 0x7f308c071660 2024-09-19T05:39:21.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.332+0000 7f30897fa640 1 -- 172.21.15.103:0/3482282253 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f308005cfb0 con 0x7f308c071660 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f307006c2b0 msgr2=0x7f307006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f307006c2b0 0x7f307006e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f308c1e8a60 tx=0x7f3078009040 comp rx=0 tx=0).stop 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c071660 msgr2=0x7f308c0c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c071660 0x7f308c0c7740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f308000e870 tx=0x7f308000ed30 comp rx=0 tx=0).stop 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 shutdown_connections 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f307006c2b0 0x7f307006e770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f308c159420 0x7f308c15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f308c0ca040 0x7f308c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 --2- 172.21.15.103:0/3482282253 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f308c071660 0x7f308c0c7740 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 >> 172.21.15.103:0/3482282253 conn(0x7f308c06f910 msgr2=0x7f308c154210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 shutdown_connections 2024-09-19T05:39:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:21.334+0000 7f3092f91640 1 -- 172.21.15.103:0/3482282253 wait complete. 2024-09-19T05:39:21.348 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T05:39:31.349 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T05:39:31.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:39:31.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.450+0000 7fe60d6f1640 1 Processor -- start 2024-09-19T05:39:31.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.450+0000 7fe60d6f1640 1 -- start start 2024-09-19T05:39:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe60d6f1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608152cc0 0x7fe608071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe60d6f1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe6081530a0 0x7fe608071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe60d6f1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6080c8a90 con 0x7fe60815c670 2024-09-19T05:39:31.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe60d6f1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe6080cf570 con 0x7fe6081530a0 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe60d6f1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe6080c7f10 con 0x7fe608152cc0 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe6077fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe60815c670 0x7fe6080c5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60910/0 (socket says 172.21.15.103:60910) 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe6077fe640 1 -- 172.21.15.103:0/2620391278 learned_addr learned my addr 172.21.15.103:0/2620391278 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe606ffd640 1 --2- 172.21.15.103:0/2620391278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608152cc0 0x7fe608071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe6067fc640 1 --2- 172.21.15.103:0/2620391278 >> v2:172.21.15.103:3300/0 conn(0x7fe6081530a0 0x7fe608071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe605ffb640 1 -- 172.21.15.103:0/2620391278 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803000537 0 0) 0x7fe6080c8a90 con 0x7fe60815c670 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.451+0000 7fe605ffb640 1 -- 172.21.15.103:0/2620391278 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5f0003520 con 0x7fe60815c670 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.452+0000 7fe606ffd640 1 -- 172.21.15.103:0/2620391278 >> v2:172.21.15.103:3300/0 conn(0x7fe6081530a0 msgr2=0x7fe608071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.452+0000 7fe606ffd640 1 --2- 172.21.15.103:0/2620391278 >> v2:172.21.15.103:3300/0 conn(0x7fe6081530a0 0x7fe608071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.452+0000 7fe605ffb640 1 -- 172.21.15.103:0/2620391278 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4106857546 0 0) 0x7fe5f0003520 con 0x7fe60815c670 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.452+0000 7fe606ffd640 1 -- 172.21.15.103:0/2620391278 >> v1:172.21.15.103:6789/0 conn(0x7fe60815c670 legacy=0x7fe6080c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.452+0000 7fe606ffd640 1 -- 172.21.15.103:0/2620391278 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6080c81f0 con 0x7fe608152cc0 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.453+0000 7fe606ffd640 1 --2- 172.21.15.103:0/2620391278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608152cc0 0x7fe608071120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80097a0 tx=0x7fe5f802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8827d1473b9c2aba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.453+0000 7fe605ffb640 1 -- 172.21.15.103:0/2620391278 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8037070 con 0x7fe608152cc0 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.453+0000 7fe605ffb640 1 -- 172.21.15.103:0/2620391278 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f802ac30 con 0x7fe608152cc0 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.453+0000 7fe605ffb640 1 -- 172.21.15.103:0/2620391278 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6000019f0 con 0x7fe608152cc0 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2620391278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608152cc0 msgr2=0x7fe608071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2620391278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608152cc0 0x7fe608071120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80097a0 tx=0x7fe5f802a1a0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2620391278 shutdown_connections 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2620391278 >> v2:172.21.15.103:3300/0 conn(0x7fe6081530a0 0x7fe608071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2620391278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe608152cc0 0x7fe608071120 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2620391278 >> 172.21.15.103:0/2620391278 conn(0x7fe60806f910 msgr2=0x7fe6080735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2620391278 shutdown_connections 2024-09-19T05:39:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.454+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2620391278 wait complete. 2024-09-19T05:39:31.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.455+0000 7fe60d6f1640 1 Processor -- start 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.455+0000 7fe60d6f1640 1 -- start start 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe60d6f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe608152cc0 0x7fe60814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe60d6f1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6081530a0 0x7fe60813d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe60d6f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60815c670 0x7fe60813d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe60d6f1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe60815c150 con 0x7fe608152cc0 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe608152cc0 0x7fe60814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe608152cc0 0x7fe60814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33932/0 (socket says 172.21.15.103:33932) 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 -- 172.21.15.103:0/2913304128 learned_addr learned my addr 172.21.15.103:0/2913304128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe60d6f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe6080c87b0 con 0x7fe60815c670 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe6080c7b90 con 0x7fe6081530a0 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 -- 172.21.15.103:0/2913304128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6081530a0 msgr2=0x7fe60813d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6081530a0 0x7fe60813d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 -- 172.21.15.103:0/2913304128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60815c670 msgr2=0x7fe60813d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60815c670 0x7fe60813d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 -- 172.21.15.103:0/2913304128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60806e020 con 0x7fe608152cc0 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.456+0000 7fe606ffd640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe608152cc0 0x7fe60814e8e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098c0 tx=0x7fe5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.457+0000 7fe5ef7fe640 1 -- 172.21.15.103:0/2913304128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8041070 con 0x7fe608152cc0 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.457+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6081f4ae0 con 0x7fe608152cc0 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.457+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60806dd40 con 0x7fe608152cc0 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.457+0000 7fe5ef7fe640 1 -- 172.21.15.103:0/2913304128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f803c660 con 0x7fe608152cc0 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.457+0000 7fe5ef7fe640 1 -- 172.21.15.103:0/2913304128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f804b060 con 0x7fe608152cc0 2024-09-19T05:39:31.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.458+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60815cac0 con 0x7fe608152cc0 2024-09-19T05:39:31.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.459+0000 7fe5ef7fe640 1 -- 172.21.15.103:0/2913304128 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe5f8044070 con 0x7fe608152cc0 2024-09-19T05:39:31.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.460+0000 7fe5ef7fe640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe5f406c2b0 0x7fe5f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.460+0000 7fe5ef7fe640 1 -- 172.21.15.103:0/2913304128 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe5f80ac2e0 con 0x7fe608152cc0 2024-09-19T05:39:31.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.460+0000 7fe6067fc640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe5f406c2b0 0x7fe5f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.461+0000 7fe6067fc640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe5f406c2b0 0x7fe5f406e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc006a90 tx=0x7fe5fc006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.469+0000 7fe5ef7fe640 1 -- 172.21.15.103:0/2913304128 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe5f807a650 con 0x7fe608152cc0 2024-09-19T05:39:31.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.710+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe608069380 con 0x7fe608152cc0 2024-09-19T05:39:31.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.710+0000 7fe5ef7fe640 1 -- 172.21.15.103:0/2913304128 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fe5f8079f50 con 0x7fe608152cc0 2024-09-19T05:39:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:39:31.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe5f406c2b0 msgr2=0x7fe5f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe5f406c2b0 0x7fe5f406e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc006a90 tx=0x7fe5fc006a20 comp rx=0 tx=0).stop 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe608152cc0 msgr2=0x7fe60814e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe608152cc0 0x7fe60814e8e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098c0 tx=0x7fe5f80046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 shutdown_connections 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe5f406c2b0 0x7fe5f406e770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60815c670 0x7fe60813d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6081530a0 0x7fe60813d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 --2- 172.21.15.103:0/2913304128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe608152cc0 0x7fe60814e8e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 >> 172.21.15.103:0/2913304128 conn(0x7fe60806f910 msgr2=0x7fe6080ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 shutdown_connections 2024-09-19T05:39:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.713+0000 7fe60d6f1640 1 -- 172.21.15.103:0/2913304128 wait complete. 2024-09-19T05:39:31.727 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T05:39:31.727 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T05:39:31.727 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T05:39:31.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T05:39:31.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.829+0000 7f5af22d7640 1 Processor -- start 2024-09-19T05:39:31.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.829+0000 7f5af22d7640 1 -- start start 2024-09-19T05:39:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5af22d7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5aec159660 0x7f5aec15fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5af22d7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec06c710 0x7f5aec06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5af22d7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5aec06f930 0x7f5aec06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5af22d7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec070a10 con 0x7f5aec159660 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5af22d7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec160320 con 0x7f5aec06f930 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5af22d7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec06fe90 con 0x7f5aec06c710 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5aebfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5aec159660 0x7f5aec15fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5aebfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5aec159660 0x7f5aec15fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33948/0 (socket says 172.21.15.103:33948) 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5aebfff640 1 -- 172.21.15.103:0/4246623902 learned_addr learned my addr 172.21.15.103:0/4246623902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.830+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/4246623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec06c710 0x7f5aec06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.831+0000 7f5af0874640 1 --2- 172.21.15.103:0/4246623902 >> v2:172.21.15.174:3300/0 conn(0x7f5aec06f930 0x7f5aec06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.831+0000 7f5aebfff640 1 -- 172.21.15.103:0/4246623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec06c710 msgr2=0x7f5aec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.831+0000 7f5aebfff640 1 --2- 172.21.15.103:0/4246623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec06c710 0x7f5aec06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.831+0000 7f5aebfff640 1 -- 172.21.15.103:0/4246623902 >> v2:172.21.15.174:3300/0 conn(0x7f5aec06f930 msgr2=0x7f5aec06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.831+0000 7f5aebfff640 1 --2- 172.21.15.103:0/4246623902 >> v2:172.21.15.174:3300/0 conn(0x7f5aec06f930 0x7f5aec06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.831+0000 7f5aebfff640 1 -- 172.21.15.103:0/4246623902 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec070170 con 0x7f5aec159660 2024-09-19T05:39:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.831+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/4246623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec06c710 0x7f5aec06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.832+0000 7f5aebfff640 1 --2- 172.21.15.103:0/4246623902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec159660 0x7f5aec15fde0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0c49f0 tx=0x7f5adc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba3f7ba852dcf41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.832+0000 7f5aeaffd640 1 -- 172.21.15.103:0/4246623902 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc037070 con 0x7f5aec159660 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.832+0000 7f5aeaffd640 1 -- 172.21.15.103:0/4246623902 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc032440 con 0x7f5aec159660 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.832+0000 7f5aeaffd640 1 -- 172.21.15.103:0/4246623902 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc032810 con 0x7f5aec159660 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 -- 172.21.15.103:0/4246623902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec159660 msgr2=0x7f5aec15fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 --2- 172.21.15.103:0/4246623902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec159660 0x7f5aec15fde0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0c49f0 tx=0x7f5adc02a1e0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 -- 172.21.15.103:0/4246623902 shutdown_connections 2024-09-19T05:39:31.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 --2- 172.21.15.103:0/4246623902 >> v2:172.21.15.174:3300/0 conn(0x7f5aec06f930 0x7f5aec06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 --2- 172.21.15.103:0/4246623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec06c710 0x7f5aec06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 --2- 172.21.15.103:0/4246623902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec159660 0x7f5aec15fde0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 -- 172.21.15.103:0/4246623902 >> 172.21.15.103:0/4246623902 conn(0x7f5aec0ca140 msgr2=0x7f5aec0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:31.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 -- 172.21.15.103:0/4246623902 shutdown_connections 2024-09-19T05:39:31.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.833+0000 7f5af22d7640 1 -- 172.21.15.103:0/4246623902 wait complete. 2024-09-19T05:39:31.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.834+0000 7f5af22d7640 1 Processor -- start 2024-09-19T05:39:31.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.834+0000 7f5af22d7640 1 -- start start 2024-09-19T05:39:31.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5af22d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec06c710 0x7f5aec15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5af22d7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aec06f930 0x7f5aec152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5af22d7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec159660 0x7f5aec150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5af22d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec072440 con 0x7f5aec06c710 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5aebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec06c710 0x7f5aec15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5af22d7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec070730 con 0x7f5aec06f930 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5af22d7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec159a40 con 0x7f5aec159660 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5aebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec06c710 0x7f5aec15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33954/0 (socket says 172.21.15.103:33954) 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.835+0000 7f5aebfff640 1 -- 172.21.15.103:0/1581808173 learned_addr learned my addr 172.21.15.103:0/1581808173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aec06f930 0x7f5aec152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5af0874640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec159660 0x7f5aec150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aebfff640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec159660 msgr2=0x7f5aec150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aebfff640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5aec159660 0x7f5aec150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aebfff640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aec06f930 msgr2=0x7f5aec152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aebfff640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aec06f930 0x7f5aec152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aebfff640 1 -- 172.21.15.103:0/1581808173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec1532a0 con 0x7f5aec06c710 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aec06f930 0x7f5aec152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5aebfff640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec06c710 0x7f5aec15e2d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5adc02a220 tx=0x7f5adc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc041020 con 0x7f5aec06c710 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc0306c0 con 0x7f5aec06c710 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec153580 con 0x7f5aec06c710 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.836+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc037040 con 0x7f5aec06c710 2024-09-19T05:39:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.837+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec153b40 con 0x7f5aec06c710 2024-09-19T05:39:31.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.838+0000 7f5af22d7640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec152aa0 0x7f5aec150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.838+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec14f9d0 con 0x7f5aec152aa0 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.838+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec152aa0 0x7f5aec150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.838+0000 7f5aeb7fe640 1 -- 172.21.15.103:0/1581808173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5aec15fde0 con 0x7f5aec152aa0 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.839+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec152aa0 0x7f5aec150f50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5aec15c400 tx=0x7f5ae0010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.839+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5adc044020 con 0x7f5aec06c710 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.839+0000 7f5ae8ff9640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5ad806c2b0 0x7f5ad806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5adc0ac110 con 0x7f5aec06c710 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5af0874640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5ad806c2b0 0x7f5ad806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae001a020 con 0x7f5aec152aa0 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5ae000e990 con 0x7f5aec152aa0 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec152aa0 msgr2=0x7f5aec150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5ae8ff9640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec152aa0 0x7f5aec150f50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5aec15c400 tx=0x7f5ae0010b70 comp rx=0 tx=0).stop 2024-09-19T05:39:31.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec152aa0 msgr2=0x7f5aec150f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:31.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5ae8ff9640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec152aa0 0x7f5aec150f50 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5aec15c400 tx=0x7f5ae0010b70 comp rx=0 tx=0).stop 2024-09-19T05:39:31.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.840+0000 7f5af0874640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5ad806c2b0 0x7f5ad806e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009fd0 tx=0x7f5ae400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.852+0000 7f5af22d7640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec1f5470 0x7f5aec1f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:31.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.852+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec150770 con 0x7f5aec1f5470 2024-09-19T05:39:31.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.852+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec1f5470 0x7f5aec1f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:31.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.853+0000 7f5aeb7fe640 1 -- 172.21.15.103:0/1581808173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5aec0c8040 con 0x7f5aec1f5470 2024-09-19T05:39:31.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.853+0000 7f5aeb7fe640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec1f5470 0x7f5aec1f7f60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5aec15c400 tx=0x7f5ae0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:31.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.854+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae001a030 con 0x7f5aec1f5470 2024-09-19T05:39:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.854+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7f5ae0021c70 con 0x7f5aec1f5470 2024-09-19T05:39:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-19T05:39:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-19T05:39:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 131987, 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.862 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:31.863 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:31.864 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:31.865 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:31.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:31.867 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:31.868 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.869 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-19T05:39:31.870 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:31.871 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:31.872 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:31.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.854+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec1f5470 msgr2=0x7f5aec1f7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.854+0000 7f5ae8ff9640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec1f5470 0x7f5aec1f7f60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5aec15c400 tx=0x7f5ae0004730 comp rx=0 tx=0).stop 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.854+0000 7f5ae8ff9640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec1f5470 msgr2=0x7f5aec1f7f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.854+0000 7f5ae8ff9640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec1f5470 0x7f5aec1f7f60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5ad806c2b0 msgr2=0x7f5ad806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f5ad806c2b0 0x7f5ad806e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009fd0 tx=0x7f5ae400b040 comp rx=0 tx=0).stop 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af0874640 1 -- 172.21.15.103:0/1581808173 reap_dead start 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec06c710 msgr2=0x7f5aec15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec06c710 0x7f5aec15e2d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5adc02a220 tx=0x7f5adc0046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 shutdown_connections 2024-09-19T05:39:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 --2- 172.21.15.103:0/1581808173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5aec06c710 0x7f5aec15e2d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:31.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 >> 172.21.15.103:0/1581808173 conn(0x7f5aec0ca140 msgr2=0x7f5aec1542a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:31.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 shutdown_connections 2024-09-19T05:39:31.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:31.855+0000 7f5af22d7640 1 -- 172.21.15.103:0/1581808173 wait complete. 2024-09-19T05:39:31.877 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:39:31.877 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T05:39:31.877 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T05:39:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.031+0000 7f9574178640 1 Processor -- start 2024-09-19T05:39:32.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.032+0000 7f9574178640 1 -- start start 2024-09-19T05:39:32.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9574178640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f956c1550a0 0x7f956c0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9574178640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f956c15ee80 0x7f956c0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9574178640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c15ae80 con 0x7f956c0c7c20 2024-09-19T05:39:32.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9574178640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f956c15bd30 con 0x7f956c15ee80 2024-09-19T05:39:32.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9574178640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f956c15b120 con 0x7f956c1550a0 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9571713640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f956c15ee80 0x7f956c0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9571f14640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f956c1550a0 0x7f956c0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9571713640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f956c15ee80 0x7f956c0c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33976/0 (socket says 172.21.15.103:33976) 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9571713640 1 -- 172.21.15.103:0/1005695761 learned_addr learned my addr 172.21.15.103:0/1005695761 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.033+0000 7f9572715640 1 --1- 172.21.15.103:0/1005695761 >> v1:172.21.15.174:6789/0 conn(0x7f956c0c7c20 0x7f956c0c2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54542/0 (socket says 172.21.15.103:54542) 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.034+0000 7f9571f14640 1 -- 172.21.15.103:0/1005695761 >> v2:172.21.15.103:3300/0 conn(0x7f956c15ee80 msgr2=0x7f956c0c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.034+0000 7f9571f14640 1 --2- 172.21.15.103:0/1005695761 >> v2:172.21.15.103:3300/0 conn(0x7f956c15ee80 0x7f956c0c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.034+0000 7f9571f14640 1 -- 172.21.15.103:0/1005695761 >> v1:172.21.15.174:6789/0 conn(0x7f956c0c7c20 legacy=0x7f956c0c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.034+0000 7f9571f14640 1 -- 172.21.15.103:0/1005695761 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c15b400 con 0x7f956c1550a0 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.034+0000 7f9570f12640 1 -- 172.21.15.103:0/1005695761 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816304690 0 0) 0x7f956c15ae80 con 0x7f956c0c7c20 2024-09-19T05:39:32.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.034+0000 7f9571713640 1 --2- 172.21.15.103:0/1005695761 >> v2:172.21.15.103:3300/0 conn(0x7f956c15ee80 0x7f956c0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:32.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.035+0000 7f9571f14640 1 --2- 172.21.15.103:0/1005695761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c1550a0 0x7f956c0c8440 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f956c06ccb0 tx=0x7f956802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1276e76eaeccc608 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.035+0000 7f9570f12640 1 -- 172.21.15.103:0/1005695761 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568037070 con 0x7f956c1550a0 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.035+0000 7f9570f12640 1 -- 172.21.15.103:0/1005695761 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9568032440 con 0x7f956c1550a0 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.035+0000 7f9570f12640 1 -- 172.21.15.103:0/1005695761 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568032810 con 0x7f956c1550a0 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 -- 172.21.15.103:0/1005695761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c1550a0 msgr2=0x7f956c0c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 --2- 172.21.15.103:0/1005695761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c1550a0 0x7f956c0c8440 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f956c06ccb0 tx=0x7f956802a1a0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 -- 172.21.15.103:0/1005695761 shutdown_connections 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 --2- 172.21.15.103:0/1005695761 >> v2:172.21.15.103:3300/0 conn(0x7f956c15ee80 0x7f956c0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 --2- 172.21.15.103:0/1005695761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c1550a0 0x7f956c0c8440 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 -- 172.21.15.103:0/1005695761 >> 172.21.15.103:0/1005695761 conn(0x7f956c067ec0 msgr2=0x7f956c06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 -- 172.21.15.103:0/1005695761 shutdown_connections 2024-09-19T05:39:32.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.036+0000 7f9574178640 1 -- 172.21.15.103:0/1005695761 wait complete. 2024-09-19T05:39:32.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.038+0000 7f9574178640 1 Processor -- start 2024-09-19T05:39:32.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.038+0000 7f9574178640 1 -- start start 2024-09-19T05:39:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9574178640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0c7c20 0x7f956c1f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9574178640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f956c1550a0 0x7f956c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9574178640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f956c15ee80 0x7f956c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9574178640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0c20b0 con 0x7f956c15ee80 2024-09-19T05:39:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9574178640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f956c15b9c0 con 0x7f956c0c7c20 2024-09-19T05:39:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9574178640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f956c15f260 con 0x7f956c1550a0 2024-09-19T05:39:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9572715640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f956c15ee80 0x7f956c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9572715640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f956c15ee80 0x7f956c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33984/0 (socket says 172.21.15.103:33984) 2024-09-19T05:39:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9572715640 1 -- 172.21.15.103:0/1642779490 learned_addr learned my addr 172.21.15.103:0/1642779490 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.039+0000 7f9571f14640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0c7c20 0x7f956c1f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9571713640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f956c1550a0 0x7f956c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9571f14640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f956c1550a0 msgr2=0x7f956c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9571f14640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f956c1550a0 0x7f956c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9571f14640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f956c15ee80 msgr2=0x7f956c0caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9571f14640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f956c15ee80 0x7f956c0caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9571f14640 1 -- 172.21.15.103:0/1642779490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c0cc3c0 con 0x7f956c0c7c20 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9571f14640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0c7c20 0x7f956c1f1590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9568031000 tx=0x7f95680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568041030 con 0x7f956c0c7c20 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9568030500 con 0x7f956c0c7c20 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568037040 con 0x7f956c0c7c20 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c0cc6a0 con 0x7f956c0c7c20 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.040+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c0ccc60 con 0x7f956c0c7c20 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.041+0000 7f9574178640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0ccea0 0x7f956c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.041+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0cd590 con 0x7f956c0ccea0 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.042+0000 7f9571713640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0ccea0 0x7f956c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.042+0000 7f9571713640 1 -- 172.21.15.103:0/1642779490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f956c155480 con 0x7f956c0ccea0 2024-09-19T05:39:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.042+0000 7f9571713640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0ccea0 0x7f956c0caf90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f956c071d20 tx=0x7f955c011990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.042+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9568044070 con 0x7f956c0c7c20 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.043+0000 7f95627fc640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f955006c2b0 0x7f955006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.043+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c015870 con 0x7f956c0ccea0 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.043+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f95680abe90 con 0x7f956c0c7c20 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.043+0000 7f9572715640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f955006c2b0 0x7f955006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.044+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f955c015a10 con 0x7f956c0ccea0 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.044+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0ccea0 msgr2=0x7f956c0caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.044+0000 7f95627fc640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0ccea0 0x7f956c0caf90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f956c071d20 tx=0x7f955c011990 comp rx=0 tx=0).stop 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.044+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0ccea0 msgr2=0x7f956c0caf90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.044+0000 7f95627fc640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0ccea0 0x7f956c0caf90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.044+0000 7f9572715640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f955006c2b0 0x7f955006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95640012e0 tx=0x7f9564001760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.056+0000 7f9574178640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0cbe70 0x7f956c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.056+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0c8220 con 0x7f956c0cbe70 2024-09-19T05:39:32.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.056+0000 7f9571713640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0cbe70 0x7f956c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.057+0000 7f9571713640 1 -- 172.21.15.103:0/1642779490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f956c074040 con 0x7f956c0cbe70 2024-09-19T05:39:32.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.057+0000 7f9571713640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0cbe70 0x7f956c0c5aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f956c071d20 tx=0x7f955c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.057+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c0064d0 con 0x7f956c0cbe70 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f955c0064d0 con 0x7f956c0cbe70 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0cbe70 msgr2=0x7f956c0c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f95627fc640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0cbe70 0x7f956c0c5aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f956c071d20 tx=0x7f955c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:39:32.061 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 132151, 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:32.062 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:32.063 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:32.066 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.068 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:32.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:32.071 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.073 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.074 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.075 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:32.076 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.077 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:32.077 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f95627fc640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0cbe70 msgr2=0x7f956c0c5aa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f95627fc640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0cbe70 0x7f956c0c5aa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f955006c2b0 msgr2=0x7f955006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f9574178640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f955006c2b0 0x7f955006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95640012e0 tx=0x7f9564001760 comp rx=0 tx=0).stop 2024-09-19T05:39:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0c7c20 msgr2=0x7f956c1f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f9574178640 1 --2- 172.21.15.103:0/1642779490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f956c0c7c20 0x7f956c1f1590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9568031000 tx=0x7f95680046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.058+0000 7f9572715640 1 -- 172.21.15.103:0/1642779490 reap_dead start 2024-09-19T05:39:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.059+0000 7f9572715640 1 -- 172.21.15.103:0/1642779490 reap_dead start 2024-09-19T05:39:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.059+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 shutdown_connections 2024-09-19T05:39:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.059+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 >> 172.21.15.103:0/1642779490 conn(0x7f956c067ec0 msgr2=0x7f956c0c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.059+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 shutdown_connections 2024-09-19T05:39:32.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.059+0000 7f9574178640 1 -- 172.21.15.103:0/1642779490 wait complete. 2024-09-19T05:39:32.081 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:39:32.081 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T05:39:32.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T05:39:32.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.231+0000 7fb47e2af640 1 Processor -- start 2024-09-19T05:39:32.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.231+0000 7fb47e2af640 1 -- start start 2024-09-19T05:39:32.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb47e2af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb478159660 0x7fb47815fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb47e2af640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb47806c710 0x7fb47806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb47e2af640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb478160320 con 0x7fb47806f930 2024-09-19T05:39:32.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb47e2af640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb478070a10 con 0x7fb47806c710 2024-09-19T05:39:32.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb47e2af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb47806fe90 con 0x7fb478159660 2024-09-19T05:39:32.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb4777fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb47806c710 0x7fb47806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb47c84c640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb47806f930 0x7fb478072960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:54552/0 (socket says 172.21.15.103:54552) 2024-09-19T05:39:32.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb47c84c640 1 -- 172.21.15.103:0/119595921 learned_addr learned my addr 172.21.15.103:0/119595921 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:39:32.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb477fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb478159660 0x7fb47815fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb476ffd640 1 -- 172.21.15.103:0/119595921 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469433406 0 0) 0x7fb478160320 con 0x7fb47806f930 2024-09-19T05:39:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb476ffd640 1 -- 172.21.15.103:0/119595921 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb460003520 con 0x7fb47806f930 2024-09-19T05:39:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb477fff640 1 -- 172.21.15.103:0/119595921 >> v2:172.21.15.103:3300/0 conn(0x7fb47806c710 msgr2=0x7fb47806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.232+0000 7fb477fff640 1 --2- 172.21.15.103:0/119595921 >> v2:172.21.15.103:3300/0 conn(0x7fb47806c710 0x7fb47806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.233+0000 7fb477fff640 1 -- 172.21.15.103:0/119595921 >> v1:172.21.15.174:6789/0 conn(0x7fb47806f930 legacy=0x7fb478072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.233+0000 7fb477fff640 1 -- 172.21.15.103:0/119595921 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb478070170 con 0x7fb478159660 2024-09-19T05:39:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.233+0000 7fb4777fe640 1 --2- 172.21.15.103:0/119595921 >> v2:172.21.15.103:3300/0 conn(0x7fb47806c710 0x7fb47806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.234+0000 7fb477fff640 1 --2- 172.21.15.103:0/119595921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb478159660 0x7fb47815fde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4680097a0 tx=0x7fb46802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da84ccf01f45bfa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.234+0000 7fb476ffd640 1 -- 172.21.15.103:0/119595921 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468037070 con 0x7fb478159660 2024-09-19T05:39:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.234+0000 7fb476ffd640 1 -- 172.21.15.103:0/119595921 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb468032440 con 0x7fb478159660 2024-09-19T05:39:32.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.234+0000 7fb476ffd640 1 -- 172.21.15.103:0/119595921 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468032810 con 0x7fb478159660 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 -- 172.21.15.103:0/119595921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb478159660 msgr2=0x7fb47815fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 --2- 172.21.15.103:0/119595921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb478159660 0x7fb47815fde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4680097a0 tx=0x7fb46802a180 comp rx=0 tx=0).stop 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 -- 172.21.15.103:0/119595921 shutdown_connections 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 --2- 172.21.15.103:0/119595921 >> v2:172.21.15.103:3300/0 conn(0x7fb47806c710 0x7fb47806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 --2- 172.21.15.103:0/119595921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb478159660 0x7fb47815fde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 -- 172.21.15.103:0/119595921 >> 172.21.15.103:0/119595921 conn(0x7fb4780ca140 msgr2=0x7fb4780ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 -- 172.21.15.103:0/119595921 shutdown_connections 2024-09-19T05:39:32.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.235+0000 7fb47e2af640 1 -- 172.21.15.103:0/119595921 wait complete. 2024-09-19T05:39:32.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.236+0000 7fb47e2af640 1 Processor -- start 2024-09-19T05:39:32.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.236+0000 7fb47e2af640 1 -- start start 2024-09-19T05:39:32.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb47e2af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb47806c710 0x7fb47815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb47e2af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47806f930 0x7fb47814f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb47e2af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb478159660 0x7fb47814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb47e2af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb478072440 con 0x7fb478159660 2024-09-19T05:39:32.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb47e2af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb478070730 con 0x7fb47806c710 2024-09-19T05:39:32.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb47e2af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb478159a40 con 0x7fb47806f930 2024-09-19T05:39:32.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb477fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb47806c710 0x7fb47815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb477fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb47806c710 0x7fb47815bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.103:43990/0 (socket says 172.21.15.103:43990) 2024-09-19T05:39:32.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb477fff640 1 -- 172.21.15.103:0/3527005953 learned_addr learned my addr 172.21.15.103:0/3527005953 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:32.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb4777fe640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47806f930 0x7fb47814f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.237+0000 7fb47c84c640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb478159660 0x7fb47814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb477fff640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47806f930 msgr2=0x7fb47814f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb477fff640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47806f930 0x7fb47814f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb477fff640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb478159660 msgr2=0x7fb47814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb477fff640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb478159660 0x7fb47814f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb477fff640 1 -- 172.21.15.103:0/3527005953 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47815af40 con 0x7fb47806c710 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb4777fe640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47806f930 0x7fb47814f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb477fff640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb47806c710 0x7fb47815bfe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4680098c0 tx=0x7fb4680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468041020 con 0x7fb47806c710 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46803d640 con 0x7fb47806c710 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468037040 con 0x7fb47806c710 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb47815b220 con 0x7fb47806c710 2024-09-19T05:39:32.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.238+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb47815b7e0 con 0x7fb47806c710 2024-09-19T05:39:32.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.239+0000 7fb47e2af640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47815bbc0 0x7fb47815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.239+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb47815fde0 con 0x7fb47815bbc0 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.240+0000 7fb4777fe640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47815bbc0 0x7fb47815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.240+0000 7fb4777fe640 1 -- 172.21.15.103:0/3527005953 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4780c8040 con 0x7fb47815bbc0 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.240+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb468044020 con 0x7fb47806c710 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.240+0000 7fb4777fe640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47815bbc0 0x7fb47815ca20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4781ec6b0 tx=0x7fb46c00f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.240+0000 7fb474ff9640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb46406c2b0 0x7fb46406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb4680abed0 con 0x7fb47806c710 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c014440 con 0x7fb47815bbc0 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb46c0145e0 con 0x7fb47815bbc0 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47815bbc0 msgr2=0x7fb47815ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb474ff9640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47815bbc0 0x7fb47815ca20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4781ec6b0 tx=0x7fb46c00f610 comp rx=0 tx=0).stop 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47815bbc0 msgr2=0x7fb47815ca20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb474ff9640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb47815bbc0 0x7fb47815ca20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.241+0000 7fb47c84c640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb46406c2b0 0x7fb46406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.242+0000 7fb47c84c640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb46406c2b0 0x7fb46406e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb470005c00 tx=0x7fb470009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.253 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:39:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-19T05:39:32.253 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 16837, 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:32.255 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:32.256 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:32.257 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:32.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:32.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:32.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:32.262 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:32.264 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:32.265 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:32.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.247+0000 7fb47e2af640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4781f4d30 0x7fb4781f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.247+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb4780c8d70 con 0x7fb4781f4d30 2024-09-19T05:39:32.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.247+0000 7fb4777fe640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4781f4d30 0x7fb4781f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb4777fe640 1 -- 172.21.15.103:0/3527005953 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb4780c8710 con 0x7fb4781f4d30 2024-09-19T05:39:32.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb4777fe640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4781f4d30 0x7fb4781f82a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00fb30 tx=0x7fb46c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0229a0 con 0x7fb4781f4d30 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fb46c02c400 con 0x7fb4781f4d30 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4781f4d30 msgr2=0x7fb4781f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb474ff9640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4781f4d30 0x7fb4781f82a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00fb30 tx=0x7fb46c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb474ff9640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4781f4d30 msgr2=0x7fb4781f82a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.248+0000 7fb474ff9640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4781f4d30 0x7fb4781f82a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb46406c2b0 msgr2=0x7fb46406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb46406c2b0 0x7fb46406e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb470005c00 tx=0x7fb470009040 comp rx=0 tx=0).stop 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47c84c640 1 -- 172.21.15.103:0/3527005953 reap_dead start 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb47806c710 msgr2=0x7fb47815bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb47806c710 0x7fb47815bfe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4680098c0 tx=0x7fb4680046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 shutdown_connections 2024-09-19T05:39:32.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 --2- 172.21.15.103:0/3527005953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb47806c710 0x7fb47815bfe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 >> 172.21.15.103:0/3527005953 conn(0x7fb4780ca140 msgr2=0x7fb47806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 shutdown_connections 2024-09-19T05:39:32.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.249+0000 7fb47e2af640 1 -- 172.21.15.103:0/3527005953 wait complete. 2024-09-19T05:39:32.270 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:39:32.270 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-19T05:39:32.270 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T05:39:32.270 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-19T05:39:32.271 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T05:39:32.271 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T05:39:32.271 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:39:32.287 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T05:39:32.287 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T05:39:32.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:39:32.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.397+0000 7f6665c1e640 1 Processor -- start 2024-09-19T05:39:32.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.397+0000 7f6665c1e640 1 -- start start 2024-09-19T05:39:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f6665c1e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6660159770 0x7f666015fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f6665c1e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6660162810 0x7f66600cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f6665c1e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666015f220 con 0x7f66600cce00 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f6665c1e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f6660160220 con 0x7f6660159770 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f6665c1e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f66600cb540 con 0x7f6660162810 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f665effd640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f66600cce00 legacy=0x7f66600c5740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f665ffff640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f6660162810 msgr2=0x7f66600cd2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f665ffff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6660162810 0x7f66600cd2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f665f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6660159770 0x7f666015fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f665f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6660159770 0x7f666015fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34006/0 (socket says 172.21.15.103:34006) 2024-09-19T05:39:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.398+0000 7f665f7fe640 1 -- 172.21.15.103:0/4254513389 learned_addr learned my addr 172.21.15.103:0/4254513389 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:32.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.399+0000 7f665f7fe640 1 -- 172.21.15.103:0/4254513389 >> v2:172.21.15.174:3300/0 conn(0x7f6660162810 msgr2=0x7f66600cd2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:32.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.399+0000 7f665f7fe640 1 --2- 172.21.15.103:0/4254513389 >> v2:172.21.15.174:3300/0 conn(0x7f6660162810 0x7f66600cd2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.399+0000 7f665f7fe640 1 -- 172.21.15.103:0/4254513389 >> v1:172.21.15.174:6789/0 conn(0x7f66600cce00 legacy=0x7f66600c5740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:32.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.399+0000 7f665f7fe640 1 -- 172.21.15.103:0/4254513389 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600cb790 con 0x7f6660159770 2024-09-19T05:39:32.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.399+0000 7f665f7fe640 1 --2- 172.21.15.103:0/4254513389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f666015fce0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66600ce750 tx=0x7f665002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27764746eeaa9b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.400+0000 7f665e7fc640 1 -- 172.21.15.103:0/4254513389 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650037070 con 0x7f6660159770 2024-09-19T05:39:32.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.400+0000 7f665e7fc640 1 -- 172.21.15.103:0/4254513389 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6650032440 con 0x7f6660159770 2024-09-19T05:39:32.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.400+0000 7f665e7fc640 1 -- 172.21.15.103:0/4254513389 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650032810 con 0x7f6660159770 2024-09-19T05:39:32.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.400+0000 7f6665c1e640 1 -- 172.21.15.103:0/4254513389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 msgr2=0x7f666015fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.400+0000 7f6665c1e640 1 --2- 172.21.15.103:0/4254513389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f666015fce0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66600ce750 tx=0x7f665002a250 comp rx=0 tx=0).stop 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.401+0000 7f6665c1e640 1 -- 172.21.15.103:0/4254513389 shutdown_connections 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.401+0000 7f6665c1e640 1 --2- 172.21.15.103:0/4254513389 >> v2:172.21.15.174:3300/0 conn(0x7f6660162810 0x7f66600cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.401+0000 7f6665c1e640 1 --2- 172.21.15.103:0/4254513389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f666015fce0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.401+0000 7f6665c1e640 1 -- 172.21.15.103:0/4254513389 >> 172.21.15.103:0/4254513389 conn(0x7f6660073340 msgr2=0x7f6660073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.401+0000 7f6665c1e640 1 -- 172.21.15.103:0/4254513389 shutdown_connections 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.401+0000 7f6665c1e640 1 -- 172.21.15.103:0/4254513389 wait complete. 2024-09-19T05:39:32.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.403+0000 7f6665c1e640 1 Processor -- start 2024-09-19T05:39:32.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.403+0000 7f6665c1e640 1 -- start start 2024-09-19T05:39:32.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f6665c1e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66600cce00 0x7f66601f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f6665c1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f66601616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f6665c1e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6660162810 0x7f666006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f665effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f66601616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f665effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f66601616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34008/0 (socket says 172.21.15.103:34008) 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f665f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66600cce00 0x7f66601f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f665f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66600cce00 0x7f66601f9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:58524/0 (socket says 172.21.15.103:58524) 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f665effd640 1 -- 172.21.15.103:0/1598474957 learned_addr learned my addr 172.21.15.103:0/1598474957 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f665ffff640 1 -- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6660162810 msgr2=0x7f666006fb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f665ffff640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6660162810 0x7f666006fb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f666015f4e0 con 0x7f6660159770 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66600cbd50 con 0x7f6660162810 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.405+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f666015f7c0 con 0x7f66600cce00 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f665f7fe640 1 -- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6660162810 msgr2=0x7f666006fb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f665f7fe640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6660162810 0x7f666006fb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f665f7fe640 1 -- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 msgr2=0x7f66601616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f665f7fe640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f66601616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f665f7fe640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600ca660 con 0x7f66600cce00 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f665f7fe640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66600cce00 0x7f66601f9120 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6650031000 tx=0x7f66500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f6647fff640 1 -- 172.21.15.103:0/1598474957 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650041070 con 0x7f66600cce00 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.406+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66600ca900 con 0x7f66600cce00 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.407+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f666006f320 con 0x7f66600cce00 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.407+0000 7f6647fff640 1 -- 172.21.15.103:0/1598474957 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665003c870 con 0x7f66600cce00 2024-09-19T05:39:32.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.407+0000 7f6647fff640 1 -- 172.21.15.103:0/1598474957 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650037040 con 0x7f66600cce00 2024-09-19T05:39:32.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.408+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6640005290 con 0x7f66600cce00 2024-09-19T05:39:32.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.409+0000 7f6647fff640 1 -- 172.21.15.103:0/1598474957 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6650044070 con 0x7f66600cce00 2024-09-19T05:39:32.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.409+0000 7f6647fff640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f664c06c260 0x7f664c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:32.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.409+0000 7f6647fff640 1 -- 172.21.15.103:0/1598474957 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f66500ac1f0 con 0x7f66600cce00 2024-09-19T05:39:32.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.409+0000 7f665effd640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f664c06c260 0x7f664c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:32.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.410+0000 7f665effd640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f664c06c260 0x7f664c06e720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6654009420 tx=0x7f66540093b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:32.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.414+0000 7f6647fff640 1 -- 172.21.15.103:0/1598474957 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6650079fa0 con 0x7f66600cce00 2024-09-19T05:39:32.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.658+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6640005850 con 0x7f66600cce00 2024-09-19T05:39:32.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.659+0000 7f6647fff640 1 -- 172.21.15.103:0/1598474957 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f665007e2a0 con 0x7f66600cce00 2024-09-19T05:39:32.661 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:39:32.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f664c06c260 msgr2=0x7f664c06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f664c06c260 0x7f664c06e720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6654009420 tx=0x7f66540093b0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66600cce00 msgr2=0x7f66601f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66600cce00 0x7f66601f9120 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6650031000 tx=0x7f66500046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 shutdown_connections 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f664c06c260 0x7f664c06e720 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6660162810 0x7f666006fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6660159770 0x7f66601616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 --2- 172.21.15.103:0/1598474957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66600cce00 0x7f66601f9120 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 >> 172.21.15.103:0/1598474957 conn(0x7f6660073340 msgr2=0x7f6660073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 shutdown_connections 2024-09-19T05:39:32.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:32.661+0000 7f6665c1e640 1 -- 172.21.15.103:0/1598474957 wait complete. 2024-09-19T05:39:35.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:39:35.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.774+0000 7f0d76bbd640 1 Processor -- start 2024-09-19T05:39:35.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.774+0000 7f0d76bbd640 1 -- start start 2024-09-19T05:39:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d76bbd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0d7006f140 0x7f0d7015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d76bbd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d700c75c0 0x7f0d7015c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d76bbd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d700c7ef0 con 0x7f0d7006f520 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d76bbd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0d700c81d0 con 0x7f0d7006f140 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d76bbd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7015eef0 con 0x7f0d700c75c0 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d7515a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0d7006f520 0x7f0d70154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60914/0 (socket says 172.21.15.103:60914) 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d7515a640 1 -- 172.21.15.103:0/2640866061 learned_addr learned my addr 172.21.15.103:0/2640866061 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d74959640 1 -- 172.21.15.103:0/2640866061 >> v2:172.21.15.174:3300/0 conn(0x7f0d7006f140 msgr2=0x7f0d7015b8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d74959640 1 --2- 172.21.15.103:0/2640866061 >> v2:172.21.15.174:3300/0 conn(0x7f0d7006f140 0x7f0d7015b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d6ffff640 1 --2- 172.21.15.103:0/2640866061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d700c75c0 0x7f0d7015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d6f7fe640 1 -- 172.21.15.103:0/2640866061 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783101957 0 0) 0x7f0d700c7ef0 con 0x7f0d7006f520 2024-09-19T05:39:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.775+0000 7f0d6f7fe640 1 -- 172.21.15.103:0/2640866061 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d60003520 con 0x7f0d7006f520 2024-09-19T05:39:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.776+0000 7f0d6ffff640 1 -- 172.21.15.103:0/2640866061 >> v2:172.21.15.174:3300/0 conn(0x7f0d7006f140 msgr2=0x7f0d7015b8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.776+0000 7f0d6ffff640 1 --2- 172.21.15.103:0/2640866061 >> v2:172.21.15.174:3300/0 conn(0x7f0d7006f140 0x7f0d7015b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.776+0000 7f0d6ffff640 1 -- 172.21.15.103:0/2640866061 >> v1:172.21.15.103:6789/0 conn(0x7f0d7006f520 legacy=0x7f0d70154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.776+0000 7f0d6ffff640 1 -- 172.21.15.103:0/2640866061 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7015e5c0 con 0x7f0d700c75c0 2024-09-19T05:39:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.776+0000 7f0d6ffff640 1 --2- 172.21.15.103:0/2640866061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d700c75c0 0x7f0d7015c320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097a0 tx=0x7f0d5c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e47d23ea15a7aee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d6f7fe640 1 -- 172.21.15.103:0/2640866061 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c037070 con 0x7f0d700c75c0 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d6f7fe640 1 -- 172.21.15.103:0/2640866061 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5c032440 con 0x7f0d700c75c0 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d6f7fe640 1 -- 172.21.15.103:0/2640866061 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0327f0 con 0x7f0d700c75c0 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 -- 172.21.15.103:0/2640866061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d700c75c0 msgr2=0x7f0d7015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/2640866061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d700c75c0 0x7f0d7015c320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097a0 tx=0x7f0d5c02a230 comp rx=0 tx=0).stop 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 -- 172.21.15.103:0/2640866061 shutdown_connections 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/2640866061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d700c75c0 0x7f0d7015c320 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/2640866061 >> v2:172.21.15.174:3300/0 conn(0x7f0d7006f140 0x7f0d7015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 -- 172.21.15.103:0/2640866061 >> 172.21.15.103:0/2640866061 conn(0x7f0d700c9230 msgr2=0x7f0d700c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 -- 172.21.15.103:0/2640866061 shutdown_connections 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.777+0000 7f0d76bbd640 1 -- 172.21.15.103:0/2640866061 wait complete. 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.778+0000 7f0d76bbd640 1 Processor -- start 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.778+0000 7f0d76bbd640 1 -- start start 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d76bbd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d7006f140 0x7f0d700c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d76bbd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d7006f520 0x7f0d700c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d76bbd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d700c75c0 0x7f0d70147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d76bbd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0d70155370 con 0x7f0d700c75c0 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d76bbd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7015eb80 con 0x7f0d7006f140 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d76bbd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0d701554f0 con 0x7f0d7006f520 2024-09-19T05:39:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d7515a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d700c75c0 0x7f0d70147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d74959640 1 -- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d7006f140 msgr2=0x7f0d700c5550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d7515a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d700c75c0 0x7f0d70147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34018/0 (socket says 172.21.15.103:34018) 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d7515a640 1 -- 172.21.15.103:0/1254505690 learned_addr learned my addr 172.21.15.103:0/1254505690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.779+0000 7f0d74959640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d7006f140 0x7f0d700c5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d6ffff640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d7006f520 0x7f0d700c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d7515a640 1 -- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d7006f520 msgr2=0x7f0d700c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d7515a640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d7006f520 0x7f0d700c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d7515a640 1 -- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d7006f140 msgr2=0x7f0d700c5550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d7515a640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d7006f140 0x7f0d700c5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d7515a640 1 -- 172.21.15.103:0/1254505690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d700c42d0 con 0x7f0d700c75c0 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d6ffff640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d7006f520 0x7f0d700c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d7515a640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d700c75c0 0x7f0d70147230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800cbe0 tx=0x7f0d6800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d6d7fa640 1 -- 172.21.15.103:0/1254505690 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68017070 con 0x7f0d700c75c0 2024-09-19T05:39:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d6d7fa640 1 -- 172.21.15.103:0/1254505690 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6800ad40 con 0x7f0d700c75c0 2024-09-19T05:39:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d700c4ea0 con 0x7f0d700c75c0 2024-09-19T05:39:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d6d7fa640 1 -- 172.21.15.103:0/1254505690 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68012600 con 0x7f0d700c75c0 2024-09-19T05:39:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.780+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d701f10b0 con 0x7f0d700c75c0 2024-09-19T05:39:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.781+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d700c6c40 con 0x7f0d700c75c0 2024-09-19T05:39:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.782+0000 7f0d6d7fa640 1 -- 172.21.15.103:0/1254505690 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d6801a070 con 0x7f0d700c75c0 2024-09-19T05:39:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.782+0000 7f0d6d7fa640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0d5406c260 0x7f0d5406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.782+0000 7f0d6d7fa640 1 -- 172.21.15.103:0/1254505690 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f0d6808b550 con 0x7f0d700c75c0 2024-09-19T05:39:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.782+0000 7f0d74959640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0d5406c260 0x7f0d5406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.783+0000 7f0d74959640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0d5406c260 0x7f0d5406e720 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d64006fd0 tx=0x7f0d64006d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:35.787+0000 7f0d6d7fa640 1 -- 172.21.15.103:0/1254505690 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0d700c6c40 con 0x7f0d700c75c0 2024-09-19T05:39:35.843 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T05:39:35.843 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T05:39:35.843 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T05:39:35.843 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-19T05:39:35.844 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T05:39:35.848 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T05:39:35.874 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T05:39:35.876 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T05:39:35.876 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T05:39:36.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.030+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0d700c79f0 con 0x7f0d700c75c0 2024-09-19T05:39:36.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.031+0000 7f0d6d7fa640 1 -- 172.21.15.103:0/1254505690 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f0d680591e0 con 0x7f0d700c75c0 2024-09-19T05:39:36.033 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:39:36.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0d5406c260 msgr2=0x7f0d5406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0d5406c260 0x7f0d5406e720 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d64006fd0 tx=0x7f0d64006d80 comp rx=0 tx=0).stop 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d700c75c0 msgr2=0x7f0d70147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d700c75c0 0x7f0d70147230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800cbe0 tx=0x7f0d6800a430 comp rx=0 tx=0).stop 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 shutdown_connections 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f0d5406c260 0x7f0d5406e720 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d700c75c0 0x7f0d70147230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d7006f520 0x7f0d700c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 --2- 172.21.15.103:0/1254505690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d7006f140 0x7f0d700c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 >> 172.21.15.103:0/1254505690 conn(0x7f0d700c9230 msgr2=0x7f0d7015ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 shutdown_connections 2024-09-19T05:39:36.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:36.033+0000 7f0d76bbd640 1 -- 172.21.15.103:0/1254505690 wait complete. 2024-09-19T05:39:36.524 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T05:39:36.598 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T05:39:36.637 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T05:39:36.639 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T05:39:36.639 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T05:39:36.678 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T05:39:36.681 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:39:36.682 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T05:39:36.697 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-19T05:39:36.699 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-19T05:39:36.699 DEBUG:teuthology.orchestra.run.smithi103:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-19T05:39:38.662 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T05:39:38.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T05:39:38.711 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-19T05:39:38.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T05:39:39.008 DEBUG:teuthology.parallel:result is None 2024-09-19T05:39:39.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T05:39:39.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:39:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.146+0000 7f02da877640 1 Processor -- start 2024-09-19T05:39:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.146+0000 7f02da877640 1 -- start start 2024-09-19T05:39:39.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02da877640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02d40c4d00 0x7f02d40c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:39.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02da877640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d4157490 con 0x7f02d40c8c20 2024-09-19T05:39:39.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02da877640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d406bf70 con 0x7f02d4151500 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02da877640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f02d41577e0 con 0x7f02d40c4d00 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02d37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02d40c4d00 0x7f02d40c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02d8e14640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f02d40c8c20 0x7f02d40c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60928/0 (socket says 172.21.15.103:60928) 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02d3fff640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f02d4151500 legacy=0x7f02d4157c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.147+0000 7f02d8e14640 1 -- 172.21.15.103:0/308365772 learned_addr learned my addr 172.21.15.103:0/308365772 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.148+0000 7f02d37fe640 1 -- 172.21.15.103:0/308365772 >> v1:172.21.15.174:6789/0 conn(0x7f02d4151500 legacy=0x7f02d4157c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.148+0000 7f02d37fe640 1 -- 172.21.15.103:0/308365772 >> v1:172.21.15.103:6789/0 conn(0x7f02d40c8c20 legacy=0x7f02d40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:39.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.148+0000 7f02d37fe640 1 -- 172.21.15.103:0/308365772 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d406c250 con 0x7f02d40c4d00 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.148+0000 7f02d37fe640 1 --2- 172.21.15.103:0/308365772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d40c4d00 0x7f02d40c86e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f02d4157960 tx=0x7f02c802b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957cedd223d19995 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02d2ffd640 1 -- 172.21.15.103:0/308365772 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8038070 con 0x7f02d40c4d00 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02d2ffd640 1 -- 172.21.15.103:0/308365772 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c8033440 con 0x7f02d40c4d00 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02d2ffd640 1 -- 172.21.15.103:0/308365772 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c80337f0 con 0x7f02d40c4d00 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02da877640 1 -- 172.21.15.103:0/308365772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d40c4d00 msgr2=0x7f02d40c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02da877640 1 --2- 172.21.15.103:0/308365772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d40c4d00 0x7f02d40c86e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f02d4157960 tx=0x7f02c802b2d0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02da877640 1 -- 172.21.15.103:0/308365772 shutdown_connections 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02da877640 1 --2- 172.21.15.103:0/308365772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d40c4d00 0x7f02d40c86e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02da877640 1 -- 172.21.15.103:0/308365772 >> 172.21.15.103:0/308365772 conn(0x7f02d40c9230 msgr2=0x7f02d40c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02da877640 1 -- 172.21.15.103:0/308365772 shutdown_connections 2024-09-19T05:39:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.149+0000 7f02da877640 1 -- 172.21.15.103:0/308365772 wait complete. 2024-09-19T05:39:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.150+0000 7f02da877640 1 Processor -- start 2024-09-19T05:39:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02da877640 1 -- start start 2024-09-19T05:39:39.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02da877640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02d40c4d00 0x7f02d41e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:39.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02da877640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02d40c8c20 0x7f02d41f0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02da877640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d4151500 0x7f02d4150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02da877640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f02d41518e0 con 0x7f02d4151500 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02da877640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f02d406bc10 con 0x7f02d40c8c20 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02da877640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f02d4151a60 con 0x7f02d40c4d00 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02d37fe640 1 -- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02d40c8c20 msgr2=0x7f02d41f0840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02d8e14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d4151500 0x7f02d4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02d37fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02d40c8c20 0x7f02d41f0840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02d8e14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d4151500 0x7f02d4150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34022/0 (socket says 172.21.15.103:34022) 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02d8e14640 1 -- 172.21.15.103:0/4139286864 learned_addr learned my addr 172.21.15.103:0/4139286864 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.151+0000 7f02d3fff640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02d40c4d00 0x7f02d41e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d8e14640 1 -- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02d40c4d00 msgr2=0x7f02d41e4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d8e14640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02d40c4d00 0x7f02d41e4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d8e14640 1 -- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02d40c8c20 msgr2=0x7f02d41f0840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d8e14640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02d40c8c20 0x7f02d41f0840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d8e14640 1 -- 172.21.15.103:0/4139286864 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d41e0800 con 0x7f02d4151500 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d3fff640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02d40c4d00 0x7f02d41e4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d8e14640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d4151500 0x7f02d4150110 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00cae0 tx=0x7f02cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d0ff9640 1 -- 172.21.15.103:0/4139286864 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc017070 con 0x7f02d4151500 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d0ff9640 1 -- 172.21.15.103:0/4139286864 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02cc00ac40 con 0x7f02d4151500 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d4150bc0 con 0x7f02d4151500 2024-09-19T05:39:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02d0ff9640 1 -- 172.21.15.103:0/4139286864 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc012400 con 0x7f02d4151500 2024-09-19T05:39:39.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.152+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d41f0d80 con 0x7f02d4151500 2024-09-19T05:39:39.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.153+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d40c3ac0 con 0x7f02d4151500 2024-09-19T05:39:39.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.153+0000 7f02d0ff9640 1 -- 172.21.15.103:0/4139286864 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f02cc01a070 con 0x7f02d4151500 2024-09-19T05:39:39.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.154+0000 7f02d0ff9640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f02c006c260 0x7f02c006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:39.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.154+0000 7f02d3fff640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f02c006c260 0x7f02c006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:39.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.154+0000 7f02d0ff9640 1 -- 172.21.15.103:0/4139286864 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f02cc08b4f0 con 0x7f02d4151500 2024-09-19T05:39:39.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.154+0000 7f02d3fff640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f02c006c260 0x7f02c006e720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f02c4003930 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:39.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.158+0000 7f02d0ff9640 1 -- 172.21.15.103:0/4139286864 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f02cc0598f0 con 0x7f02d4151500 2024-09-19T05:39:39.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.387+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f02d41e2ca0 con 0x7f02d4151500 2024-09-19T05:39:39.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.388+0000 7f02d0ff9640 1 -- 172.21.15.103:0/4139286864 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f02cc0591f0 con 0x7f02d4151500 2024-09-19T05:39:39.390 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f02c006c260 msgr2=0x7f02c006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f02c006c260 0x7f02c006e720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f02c4003930 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d4151500 msgr2=0x7f02d4150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d4151500 0x7f02d4150110 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00cae0 tx=0x7f02cc00a060 comp rx=0 tx=0).stop 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 shutdown_connections 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f02c006c260 0x7f02c006e720 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02d4151500 0x7f02d4150110 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02d40c8c20 0x7f02d41f0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 --2- 172.21.15.103:0/4139286864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02d40c4d00 0x7f02d41e4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 >> 172.21.15.103:0/4139286864 conn(0x7f02d40c9230 msgr2=0x7f02d40729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 shutdown_connections 2024-09-19T05:39:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:39.390+0000 7f02da877640 1 -- 172.21.15.103:0/4139286864 wait complete. 2024-09-19T05:39:40.021 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T05:39:40.022 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-19T05:39:40.032 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-19T05:39:42.404 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:39:42.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.512+0000 7f98bab2c640 1 Processor -- start 2024-09-19T05:39:42.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.512+0000 7f98bab2c640 1 -- start start 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98bab2c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98bab2c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b4074350 con 0x7f98b40cab90 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98bab2c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b4074610 con 0x7f98b4152f00 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98bab2c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f98b40c8cc0 con 0x7f98b40ce6a0 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b88c8640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f98b4152f00 legacy=0x7f98b4073c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f98b40cab90 0x7f98b415c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40706/0 (socket says 172.21.15.103:40706) 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 learned_addr learned my addr 172.21.15.103:0/1389496166 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:39:42.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:42.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:42.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.513+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:42.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.714+0000 7f98b88c8640 1 -- 172.21.15.103:0/1389496166 >> v1:172.21.15.174:6789/0 conn(0x7f98b4152f00 legacy=0x7f98b4073c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-09-19T05:39:42.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.714+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:42.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.714+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:39:42.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.714+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:42.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.714+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:42.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:42.714+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:39:42.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:42.744 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:39:43.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.115+0000 7f98b88c8640 1 -- 172.21.15.103:0/1389496166 >> v1:172.21.15.174:6789/0 conn(0x7f98b4152f00 legacy=0x7f98b4073c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-09-19T05:39:43.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.115+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.115+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:39:43.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.115+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:43.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.115+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:43.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.115+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:39:43.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.917+0000 7f98b88c8640 1 -- 172.21.15.103:0/1389496166 >> v1:172.21.15.174:6789/0 conn(0x7f98b4152f00 legacy=0x7f98b4073c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-09-19T05:39:43.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.917+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:43.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.917+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:39:43.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.917+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:43.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.917+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:43.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:43.917+0000 7f98b90c9640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:39:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 msgr2=0x7f98b40ceb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b40ce6a0 0x7f98b40ceb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 -- 172.21.15.103:0/1389496166 >> v1:172.21.15.174:6789/0 conn(0x7f98b4152f00 legacy=0x7f98b4073c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 -- 172.21.15.103:0/1389496166 >> v1:172.21.15.103:6789/0 conn(0x7f98b40cab90 legacy=0x7f98b415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 0x7f9898005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 -- 172.21.15.103:0/1389496166 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f98b40c8cc0 con 0x7f98980061a0 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b27fc640 1 -- 172.21.15.103:0/1389496166 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f9898008d10 con 0x7f98980036f0 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b88c8640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 msgr2=0x7f9898005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b88c8640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 0x7f9898005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 msgr2=0x7f9898008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 msgr2=0x7f9898008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.514+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.515+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.715+0000 7f98b88c8640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 msgr2=0x7f9898005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.715+0000 7f98b88c8640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 0x7f9898005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:39:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.716+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.716+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 msgr2=0x7f9898008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:39:45.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.716+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 msgr2=0x7f9898008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:45.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.716+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:45.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:45.716+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:39:46.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.116+0000 7f98b88c8640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 msgr2=0x7f9898005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:46.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.116+0000 7f98b88c8640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 0x7f9898005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:39:46.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.117+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.117+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 msgr2=0x7f9898008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:39:46.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.117+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 msgr2=0x7f9898008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:39:46.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.117+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:39:46.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.117+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:39:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.917+0000 7f98b88c8640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 msgr2=0x7f9898005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.917+0000 7f98b88c8640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 0x7f9898005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.918+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.103:3300/0 conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.918+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 msgr2=0x7f9898005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.918+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> v2:172.21.15.174:3300/0 conn(0x7f98980036f0 0x7f9898005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.918+0000 7f98b3fff640 1 -- 172.21.15.103:0/1389496166 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b40c7f00 con 0x7f98980061a0 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.919+0000 7f98b3fff640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f9898008660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9898003680 tx=0x7f98a002a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11333bbeb06213dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.919+0000 7f98b37fe640 1 -- 172.21.15.103:0/1389496166 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0038070 con 0x7f98980061a0 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.919+0000 7f98b37fe640 1 -- 172.21.15.103:0/1389496166 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a0033410 con 0x7f98980061a0 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.919+0000 7f98b37fe640 1 -- 172.21.15.103:0/1389496166 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0033800 con 0x7f98980061a0 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98bab2c640 1 -- 172.21.15.103:0/1389496166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 msgr2=0x7f9898008660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98bab2c640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f9898008660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9898003680 tx=0x7f98a002a800 comp rx=0 tx=0).stop 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98b90c9640 1 -- 172.21.15.103:0/1389496166 reap_dead start 2024-09-19T05:39:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98bab2c640 1 -- 172.21.15.103:0/1389496166 shutdown_connections 2024-09-19T05:39:46.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98bab2c640 1 --2- 172.21.15.103:0/1389496166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f9898008660 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98bab2c640 1 -- 172.21.15.103:0/1389496166 >> 172.21.15.103:0/1389496166 conn(0x7f98b406c240 msgr2=0x7f98b4067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:46.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98bab2c640 1 -- 172.21.15.103:0/1389496166 shutdown_connections 2024-09-19T05:39:46.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.920+0000 7f98bab2c640 1 -- 172.21.15.103:0/1389496166 wait complete. 2024-09-19T05:39:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.922+0000 7f98bab2c640 1 Processor -- start 2024-09-19T05:39:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.922+0000 7f98bab2c640 1 -- start start 2024-09-19T05:39:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98bab2c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f98b40c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98bab2c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b41475c0 0x7f98b41519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98bab2c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b40c39e0 0x7f98b40c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98bab2c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98b40c87a0 con 0x7f98980061a0 2024-09-19T05:39:46.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98bab2c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f98b40c84c0 con 0x7f98b40c39e0 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98bab2c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f98b4073710 con 0x7f98b41475c0 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98b88c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f98b40c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98b90c9640 1 -- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b40c39e0 msgr2=0x7f98b40c3e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98b88c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f98b40c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41548/0 (socket says 172.21.15.103:41548) 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98b88c8640 1 -- 172.21.15.103:0/2002265248 learned_addr learned my addr 172.21.15.103:0/2002265248 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98b90c9640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b40c39e0 0x7f98b40c3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.923+0000 7f98b3fff640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b41475c0 0x7f98b41519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b88c8640 1 -- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b41475c0 msgr2=0x7f98b41519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b88c8640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b41475c0 0x7f98b41519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b88c8640 1 -- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b40c39e0 msgr2=0x7f98b40c3e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b88c8640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b40c39e0 0x7f98b40c3e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b88c8640 1 -- 172.21.15.103:0/2002265248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b41463f0 con 0x7f98980061a0 2024-09-19T05:39:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b88c8640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f98b40c4ce0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f98a800b950 tx=0x7f98a800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b17fa640 1 -- 172.21.15.103:0/2002265248 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a800cbd0 con 0x7f98980061a0 2024-09-19T05:39:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b17fa640 1 -- 172.21.15.103:0/2002265248 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a8010030 con 0x7f98980061a0 2024-09-19T05:39:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98b17fa640 1 -- 172.21.15.103:0/2002265248 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8015420 con 0x7f98980061a0 2024-09-19T05:39:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b41466d0 con 0x7f98980061a0 2024-09-19T05:39:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.924+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b4146c90 con 0x7f98980061a0 2024-09-19T05:39:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.925+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b41532e0 con 0x7f98980061a0 2024-09-19T05:39:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.926+0000 7f98b17fa640 1 -- 172.21.15.103:0/2002265248 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f98a80143d0 con 0x7f98980061a0 2024-09-19T05:39:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.926+0000 7f98b17fa640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f989806cf70 0x7f989806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.927+0000 7f98b17fa640 1 -- 172.21.15.103:0/2002265248 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f98a808b250 con 0x7f98980061a0 2024-09-19T05:39:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.927+0000 7f98b3fff640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f989806cf70 0x7f989806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.927+0000 7f98b3fff640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f989806cf70 0x7f989806f430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f98a0035000 tx=0x7f98a0010040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:46.931+0000 7f98b17fa640 1 -- 172.21.15.103:0/2002265248 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f98a8058ee0 con 0x7f98980061a0 2024-09-19T05:39:47.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.166+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f98b41490c0 con 0x7f98980061a0 2024-09-19T05:39:47.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.167+0000 7f98b17fa640 1 -- 172.21.15.103:0/2002265248 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f98a805d1e0 con 0x7f98980061a0 2024-09-19T05:39:47.168 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":14,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:39:47.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f989806cf70 msgr2=0x7f989806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f989806cf70 0x7f989806f430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f98a0035000 tx=0x7f98a0010040 comp rx=0 tx=0).stop 2024-09-19T05:39:47.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 msgr2=0x7f98b40c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f98b40c4ce0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f98a800b950 tx=0x7f98a800be10 comp rx=0 tx=0).stop 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 shutdown_connections 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f989806cf70 0x7f989806f430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b40c39e0 0x7f98b40c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b41475c0 0x7f98b41519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 --2- 172.21.15.103:0/2002265248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98980061a0 0x7f98b40c4ce0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 >> 172.21.15.103:0/2002265248 conn(0x7f98b406c240 msgr2=0x7f98b4071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 shutdown_connections 2024-09-19T05:39:47.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.169+0000 7f98bab2c640 1 -- 172.21.15.103:0/2002265248 wait complete. 2024-09-19T05:39:47.181 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T05:39:47.181 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T05:39:47.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T05:39:47.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.280+0000 7f5392242640 1 Processor -- start 2024-09-19T05:39:47.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.280+0000 7f5392242640 1 -- start start 2024-09-19T05:39:47.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f5392242640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f538c152a80 0x7f538c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f5392242640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f5392242640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c158e00 con 0x7f538c152e60 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f5392242640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f538c0c7b80 con 0x7f538c152a80 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f5392242640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f538c1590e0 con 0x7f538c06bc10 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f538c152a80 0x7f538c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f538c152e60 0x7f538c0c4b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40722/0 (socket says 172.21.15.103:40722) 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538bfff640 1 -- 172.21.15.103:0/228585421 learned_addr learned my addr 172.21.15.103:0/228585421 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f538c152a80 0x7f538c06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41562/0 (socket says 172.21.15.103:41562) 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538affd640 1 --2- 172.21.15.103:0/228585421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538b7fe640 1 -- 172.21.15.103:0/228585421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 msgr2=0x7f538c06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538b7fe640 1 --2- 172.21.15.103:0/228585421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538b7fe640 1 -- 172.21.15.103:0/228585421 >> v1:172.21.15.103:6789/0 conn(0x7f538c152e60 legacy=0x7f538c0c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538b7fe640 1 -- 172.21.15.103:0/228585421 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c1593c0 con 0x7f538c152a80 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538a7fc640 1 -- 172.21.15.103:0/228585421 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8934640 0 0) 0x7f538c158e00 con 0x7f538c152e60 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.281+0000 7f538affd640 1 --2- 172.21.15.103:0/228585421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.282+0000 7f538b7fe640 1 --2- 172.21.15.103:0/228585421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152a80 0x7f538c06cd30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f537c0097a0 tx=0x7f537c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d0015dd4d697e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.282+0000 7f538a7fc640 1 -- 172.21.15.103:0/228585421 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c037070 con 0x7f538c152a80 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.282+0000 7f538a7fc640 1 -- 172.21.15.103:0/228585421 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537c032440 con 0x7f538c152a80 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.282+0000 7f538a7fc640 1 -- 172.21.15.103:0/228585421 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c032810 con 0x7f538c152a80 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 -- 172.21.15.103:0/228585421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152a80 msgr2=0x7f538c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 --2- 172.21.15.103:0/228585421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152a80 0x7f538c06cd30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f537c0097a0 tx=0x7f537c02a180 comp rx=0 tx=0).stop 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 -- 172.21.15.103:0/228585421 shutdown_connections 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 --2- 172.21.15.103:0/228585421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 --2- 172.21.15.103:0/228585421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152a80 0x7f538c06cd30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 -- 172.21.15.103:0/228585421 >> 172.21.15.103:0/228585421 conn(0x7f538c0ca140 msgr2=0x7f538c0ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 -- 172.21.15.103:0/228585421 shutdown_connections 2024-09-19T05:39:47.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.283+0000 7f5392242640 1 -- 172.21.15.103:0/228585421 wait complete. 2024-09-19T05:39:47.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.284+0000 7f5392242640 1 Processor -- start 2024-09-19T05:39:47.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.284+0000 7f5392242640 1 -- start start 2024-09-19T05:39:47.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f5392242640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c1f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f5392242640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f538c152a80 0x7f538c0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f5392242640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152e60 0x7f538c1eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f5392242640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f538c0c77d0 con 0x7f538c152e60 2024-09-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f5392242640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f538c0cac30 con 0x7f538c152a80 2024-09-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f5392242640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f538c15c410 con 0x7f538c06bc10 2024-09-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538affd640 1 -- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f538c152a80 msgr2=0x7f538c0cc280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152e60 0x7f538c1eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538affd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f538c152a80 0x7f538c0cc280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152e60 0x7f538c1eef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41578/0 (socket says 172.21.15.103:41578) 2024-09-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 -- 172.21.15.103:0/4140750041 learned_addr learned my addr 172.21.15.103:0/4140750041 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538b7fe640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c1f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 msgr2=0x7f538c1f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538c06bc10 0x7f538c1f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f538c152a80 msgr2=0x7f538c0cc280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f538c152a80 0x7f538c0cc280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 -- 172.21.15.103:0/4140750041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c1e59e0 con 0x7f538c152e60 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.285+0000 7f538bfff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152e60 0x7f538c1eef50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f538400c730 tx=0x7f538400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.286+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384018070 con 0x7f538c152e60 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.286+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538400ce40 con 0x7f538c152e60 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.286+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c158aa0 con 0x7f538c152e60 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.286+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538400a860 con 0x7f538c152e60 2024-09-19T05:39:47.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.286+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c15c940 con 0x7f538c152e60 2024-09-19T05:39:47.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.287+0000 7f5392242640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c150b70 0x7f538c1ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.287+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1ee960 con 0x7f538c150b70 2024-09-19T05:39:47.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.287+0000 7f538b7fe640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c150b70 0x7f538c1ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.287+0000 7f538b7fe640 1 -- 172.21.15.103:0/4140750041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f538c06d4f0 con 0x7f538c150b70 2024-09-19T05:39:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.287+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f538401b070 con 0x7f538c152e60 2024-09-19T05:39:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.287+0000 7f538b7fe640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c150b70 0x7f538c1ef490 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f538c0ce660 tx=0x7f537c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f537806c260 0x7f537806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f538408ae70 con 0x7f538c152e60 2024-09-19T05:39:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f538affd640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f537806c260 0x7f537806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c042030 con 0x7f538c150b70 2024-09-19T05:39:47.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f537c038040 con 0x7f538c150b70 2024-09-19T05:39:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c150b70 msgr2=0x7f538c1ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c150b70 0x7f538c1ef490 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f538c0ce660 tx=0x7f537c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c150b70 msgr2=0x7f538c1ef490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f5373fff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c150b70 0x7f538c1ef490 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f538c0ce660 tx=0x7f537c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.288+0000 7f538affd640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f537806c260 0x7f537806e720 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f538c0cbda0 tx=0x7f5380008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.294+0000 7f5392242640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c15cb80 0x7f538c14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.294+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f538c06c800 con 0x7f538c15cb80 2024-09-19T05:39:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.294+0000 7f538b7fe640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c15cb80 0x7f538c14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.294+0000 7f538b7fe640 1 -- 172.21.15.103:0/4140750041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f538c15cf60 con 0x7f538c15cb80 2024-09-19T05:39:47.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.294+0000 7f538b7fe640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c15cb80 0x7f538c14b760 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f537c02a1c0 tx=0x7f537c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c042070 con 0x7f538c15cb80 2024-09-19T05:39:47.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7f537c03ec00 con 0x7f538c15cb80 2024-09-19T05:39:47.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c15cb80 msgr2=0x7f538c14b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5373fff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c15cb80 0x7f538c14b760 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f537c02a1c0 tx=0x7f537c008030 comp rx=0 tx=0).stop 2024-09-19T05:39:47.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5373fff640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c15cb80 msgr2=0x7f538c14b760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:47.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5373fff640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c15cb80 0x7f538c14b760 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 14, 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 147428, 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:47.300 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:47.301 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:47.302 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.305 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:47.309 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.312 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:47.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.314 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.315 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:39:47.315 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.315 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.315 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:47.315 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:47.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f537806c260 msgr2=0x7f537806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f537806c260 0x7f537806e720 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f538c0cbda0 tx=0x7f5380008040 comp rx=0 tx=0).stop 2024-09-19T05:39:47.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152e60 msgr2=0x7f538c1eef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152e60 0x7f538c1eef50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f538400c730 tx=0x7f538400cbf0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f538bfff640 1 -- 172.21.15.103:0/4140750041 reap_dead start 2024-09-19T05:39:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 shutdown_connections 2024-09-19T05:39:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 --2- 172.21.15.103:0/4140750041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f538c152e60 0x7f538c1eef50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 >> 172.21.15.103:0/4140750041 conn(0x7f538c0ca140 msgr2=0x7f538c158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 shutdown_connections 2024-09-19T05:39:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.295+0000 7f5392242640 1 -- 172.21.15.103:0/4140750041 wait complete. 2024-09-19T05:39:47.318 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T05:39:47.318 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T05:39:47.319 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T05:39:47.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.418+0000 7f6a013c6640 1 Processor -- start 2024-09-19T05:39:47.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.418+0000 7f6a013c6640 1 -- start start 2024-09-19T05:39:47.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f6a013c6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0b3540 0x7f69fc0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f6a013c6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f69fc0c5950 0x7f69fc0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f6a013c6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69fc0cbed0 con 0x7f69fc155040 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f6a013c6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f69fc15bd70 con 0x7f69fc0c5950 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f6a013c6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc0cbbf0 con 0x7f69fc0b3540 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69fb7fe640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f69fc0c5950 msgr2=0x7f69fc0cc2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69faffd640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f69fc155040 legacy=0x7f69fc15e420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69fb7fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f69fc0c5950 0x7f69fc0cc2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69f27fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0b3540 0x7f69fc0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69f27fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0b3540 0x7f69fc0cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.103:34328/0 (socket says 172.21.15.103:34328) 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69f27fc640 1 -- 172.21.15.103:0/325789441 learned_addr learned my addr 172.21.15.103:0/325789441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69f27fc640 1 -- 172.21.15.103:0/325789441 >> v2:172.21.15.174:3300/0 conn(0x7f69fc0c5950 msgr2=0x7f69fc0cc2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69f27fc640 1 --2- 172.21.15.103:0/325789441 >> v2:172.21.15.174:3300/0 conn(0x7f69fc0c5950 0x7f69fc0cc2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69f27fc640 1 -- 172.21.15.103:0/325789441 >> v1:172.21.15.174:6789/0 conn(0x7f69fc155040 legacy=0x7f69fc15e420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.419+0000 7f69f27fc640 1 -- 172.21.15.103:0/325789441 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc15afb0 con 0x7f69fc0b3540 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.420+0000 7f69f27fc640 1 --2- 172.21.15.103:0/325789441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0b3540 0x7f69fc0cb540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009870 tx=0x7f69e402a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=474c3fe620be7a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.420+0000 7f69fa7fc640 1 -- 172.21.15.103:0/325789441 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4037070 con 0x7f69fc0b3540 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.420+0000 7f69fa7fc640 1 -- 172.21.15.103:0/325789441 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e4032440 con 0x7f69fc0b3540 2024-09-19T05:39:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.420+0000 7f69fa7fc640 1 -- 172.21.15.103:0/325789441 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4032810 con 0x7f69fc0b3540 2024-09-19T05:39:47.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 -- 172.21.15.103:0/325789441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0b3540 msgr2=0x7f69fc0cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 --2- 172.21.15.103:0/325789441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0b3540 0x7f69fc0cb540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009870 tx=0x7f69e402a2c0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 -- 172.21.15.103:0/325789441 shutdown_connections 2024-09-19T05:39:47.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 --2- 172.21.15.103:0/325789441 >> v2:172.21.15.174:3300/0 conn(0x7f69fc0c5950 0x7f69fc0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 --2- 172.21.15.103:0/325789441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0b3540 0x7f69fc0cb540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 -- 172.21.15.103:0/325789441 >> 172.21.15.103:0/325789441 conn(0x7f69fc073340 msgr2=0x7f69fc073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 -- 172.21.15.103:0/325789441 shutdown_connections 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.421+0000 7f6a013c6640 1 -- 172.21.15.103:0/325789441 wait complete. 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.422+0000 7f6a013c6640 1 Processor -- start 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.422+0000 7f6a013c6640 1 -- start start 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f6a013c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0b3540 0x7f69fc0d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f6a013c6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0c5950 0x7f69fc1595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f6a013c6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69fc155040 0x7f69fc06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f6a013c6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc15b850 con 0x7f69fc0b3540 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f6a013c6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc15b570 con 0x7f69fc155040 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f6a013c6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc15eb30 con 0x7f69fc0c5950 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0b3540 0x7f69fc0d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69fb7fe640 1 -- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69fc155040 msgr2=0x7f69fc06c8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0b3540 0x7f69fc0d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41602/0 (socket says 172.21.15.103:41602) 2024-09-19T05:39:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 -- 172.21.15.103:0/2993786387 learned_addr learned my addr 172.21.15.103:0/2993786387 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69fb7fe640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69fc155040 0x7f69fc06c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69f27fc640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0c5950 0x7f69fc1595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0c5950 msgr2=0x7f69fc1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0c5950 0x7f69fc1595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69fc155040 msgr2=0x7f69fc06c8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69fc155040 0x7f69fc06c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 -- 172.21.15.103:0/2993786387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc15e120 con 0x7f69fc0b3540 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69faffd640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0b3540 0x7f69fc0d0180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00b550 tx=0x7f69ec00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.423+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec003d70 con 0x7f69fc0b3540 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.424+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec015070 con 0x7f69fc0b3540 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.424+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0052b0 con 0x7f69fc0b3540 2024-09-19T05:39:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.424+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc15a8f0 con 0x7f69fc0b3540 2024-09-19T05:39:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.424+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc06c3c0 con 0x7f69fc0b3540 2024-09-19T05:39:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.424+0000 7f6a013c6640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc158a70 0x7f69fc15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.424+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc15db60 con 0x7f69fc158a70 2024-09-19T05:39:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.425+0000 7f69f27fc640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc158a70 0x7f69fc15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.425+0000 7f69f27fc640 1 -- 172.21.15.103:0/2993786387 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69fc0cb540 con 0x7f69fc158a70 2024-09-19T05:39:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.425+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69ec005450 con 0x7f69fc0b3540 2024-09-19T05:39:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.425+0000 7f69f27fc640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc158a70 0x7f69fc15d110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0d1970 tx=0x7f69e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.425+0000 7f69f3fff640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f69dc06c260 0x7f69dc06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.425+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f69ec08b550 con 0x7f69fc0b3540 2024-09-19T05:39:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69fb7fe640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f69dc06c260 0x7f69dc06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4037040 con 0x7f69fc158a70 2024-09-19T05:39:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f69e4032e30 con 0x7f69fc158a70 2024-09-19T05:39:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc158a70 msgr2=0x7f69fc15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69f3fff640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc158a70 0x7f69fc15d110 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0d1970 tx=0x7f69e40046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc158a70 msgr2=0x7f69fc15d110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69f3fff640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc158a70 0x7f69fc15d110 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.426+0000 7f69fb7fe640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f69dc06c260 0x7f69dc06e720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69f4003cb0 tx=0x7f69f40091f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.432+0000 7f6a013c6640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0ca520 0x7f69fc14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:47.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.432+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc06c600 con 0x7f69fc0ca520 2024-09-19T05:39:47.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.432+0000 7f69f27fc640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0ca520 0x7f69fc14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:47.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.432+0000 7f69f27fc640 1 -- 172.21.15.103:0/2993786387 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69fc069380 con 0x7f69fc0ca520 2024-09-19T05:39:47.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69f27fc640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0ca520 0x7f69fc14c0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f69e402a300 tx=0x7f69e4008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:47.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4052070 con 0x7f69fc0ca520 2024-09-19T05:39:47.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f69e403ce20 con 0x7f69fc0ca520 2024-09-19T05:39:47.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0ca520 msgr2=0x7f69fc14c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69f3fff640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0ca520 0x7f69fc14c0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f69e402a300 tx=0x7f69e4008030 comp rx=0 tx=0).stop 2024-09-19T05:39:47.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69f3fff640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0ca520 msgr2=0x7f69fc14c0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:39:47.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69f3fff640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69fc0ca520 0x7f69fc14c0f0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f69e402a300 tx=0x7f69e4008030 comp rx=0 tx=0).stop 2024-09-19T05:39:47.437 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:39:47.437 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:47.437 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 14, 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 32021, 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:47.438 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:47.439 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:39:47.440 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:39:47.441 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:39:47.442 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:39:47.443 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:39:47.444 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.445 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.445 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.445 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:39:47.445 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:39:47.445 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:47.445 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:47.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:47.447 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:39:47.447 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:47.447 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:39:47.448 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.448 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.448 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.448 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:39:47.449 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:39:47.449 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:47.449 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:47.449 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:39:47.451 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.452 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:39:47.453 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:39:47.454 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:39:47.454 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:39:47.454 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:39:47.454 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:39:47.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:39:47.454 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:39:47.454 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f69dc06c260 msgr2=0x7f69dc06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f6a013c6640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f69dc06c260 0x7f69dc06e720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69f4003cb0 tx=0x7f69f40091f0 comp rx=0 tx=0).stop 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0b3540 msgr2=0x7f69fc0d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f6a013c6640 1 --2- 172.21.15.103:0/2993786387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69fc0b3540 0x7f69fc0d0180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00b550 tx=0x7f69ec00ba10 comp rx=0 tx=0).stop 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69fb7fe640 1 -- 172.21.15.103:0/2993786387 reap_dead start 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f69fb7fe640 1 -- 172.21.15.103:0/2993786387 reap_dead start 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 shutdown_connections 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.433+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 >> 172.21.15.103:0/2993786387 conn(0x7f69fc073340 msgr2=0x7f69fc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:47.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.434+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 shutdown_connections 2024-09-19T05:39:47.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:39:47.434+0000 7f6a013c6640 1 -- 172.21.15.103:0/2993786387 wait complete. 2024-09-19T05:39:47.457 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T05:39:47.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T05:40:07.458 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T05:40:07.458 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-19T05:40:07.458 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T05:40:07.459 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T05:40:07.462 INFO:tasks.ceph.mon.b:Started 2024-09-19T05:40:07.462 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T05:40:07.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:40:07.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.573+0000 7f3fed1bd640 1 Processor -- start 2024-09-19T05:40:07.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.573+0000 7f3fed1bd640 1 -- start start 2024-09-19T05:40:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fed1bd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe8152cc0 0x7f3fe8071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fed1bd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 0x7f3fe8071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fed1bd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe80c8a90 con 0x7f3fe81530a0 2024-09-19T05:40:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fed1bd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe80cf570 con 0x7f3fe815cd80 2024-09-19T05:40:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fed1bd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe80c7f10 con 0x7f3fe8152cc0 2024-09-19T05:40:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe659c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3fe81530a0 0x7f3fe815c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44632/0 (socket says 172.21.15.103:44632) 2024-09-19T05:40:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe659c640 1 -- 172.21.15.103:0/739803597 learned_addr learned my addr 172.21.15.103:0/739803597 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe759e640 1 --2- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 0x7f3fe8071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/739803597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe8152cc0 0x7f3fe8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe759e640 1 -- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 msgr2=0x7f3fe8071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe759e640 1 -- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 msgr2=0x7f3fe8071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe759e640 1 --2- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 0x7f3fe8071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe759e640 1 --2- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 0x7f3fe8071660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe5d9b640 1 -- 172.21.15.103:0/739803597 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 269713209 0 0) 0x7f3fe80c8a90 con 0x7f3fe81530a0 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe5d9b640 1 -- 172.21.15.103:0/739803597 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd0003520 con 0x7f3fe81530a0 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe6d9d640 1 -- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 msgr2=0x7f3fe8071660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 0x7f3fe8071660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe6d9d640 1 -- 172.21.15.103:0/739803597 >> v1:172.21.15.103:6789/0 conn(0x7f3fe81530a0 legacy=0x7f3fe815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.574+0000 7f3fe6d9d640 1 -- 172.21.15.103:0/739803597 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe80c81f0 con 0x7f3fe8152cc0 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.575+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/739803597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe8152cc0 0x7f3fe8071120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80097a0 tx=0x7f3fd802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c515f405343e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.575+0000 7f3fe5d9b640 1 -- 172.21.15.103:0/739803597 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8037070 con 0x7f3fe8152cc0 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.575+0000 7f3fe5d9b640 1 -- 172.21.15.103:0/739803597 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd8032440 con 0x7f3fe8152cc0 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.575+0000 7f3fe5d9b640 1 -- 172.21.15.103:0/739803597 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80327f0 con 0x7f3fe8152cc0 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.575+0000 7f3fed1bd640 1 -- 172.21.15.103:0/739803597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe8152cc0 msgr2=0x7f3fe8071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.575+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/739803597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe8152cc0 0x7f3fe8071120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80097a0 tx=0x7f3fd802a210 comp rx=0 tx=0).stop 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.576+0000 7f3fed1bd640 1 -- 172.21.15.103:0/739803597 shutdown_connections 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.576+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/739803597 >> v2:172.21.15.174:3300/0 conn(0x7f3fe815cd80 0x7f3fe8071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.576+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/739803597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe8152cc0 0x7f3fe8071120 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.576+0000 7f3fed1bd640 1 -- 172.21.15.103:0/739803597 >> 172.21.15.103:0/739803597 conn(0x7f3fe806f910 msgr2=0x7f3fe80735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.576+0000 7f3fed1bd640 1 -- 172.21.15.103:0/739803597 shutdown_connections 2024-09-19T05:40:07.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.576+0000 7f3fed1bd640 1 -- 172.21.15.103:0/739803597 wait complete. 2024-09-19T05:40:07.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.577+0000 7f3fed1bd640 1 Processor -- start 2024-09-19T05:40:07.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.577+0000 7f3fed1bd640 1 -- start start 2024-09-19T05:40:07.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fed1bd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 0x7f3fe806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fed1bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe81530a0 0x7f3fe80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fed1bd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe815cd80 0x7f3fe8143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fed1bd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe815c150 con 0x7f3fe81530a0 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fed1bd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe80c87b0 con 0x7f3fe8152cc0 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fed1bd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe80c7b90 con 0x7f3fe815cd80 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe81530a0 0x7f3fe80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe81530a0 0x7f3fe80cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52150/0 (socket says 172.21.15.103:52150) 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 -- 172.21.15.103:0/1537976897 learned_addr learned my addr 172.21.15.103:0/1537976897 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe759e640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe815cd80 0x7f3fe8143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 0x7f3fe806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe6d9d640 1 -- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 msgr2=0x7f3fe806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe6d9d640 1 -- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 msgr2=0x7f3fe806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 0x7f3fe806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 0x7f3fe806cd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 -- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe815cd80 msgr2=0x7f3fe8143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe815cd80 0x7f3fe8143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 -- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 msgr2=0x7f3fe806cd20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 0x7f3fe806cd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 -- 172.21.15.103:0/1537976897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe8152420 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.578+0000 7f3fe659c640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe81530a0 0x7f3fe80cc670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c430 tx=0x7f3fdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.579+0000 7f3fcf7fe640 1 -- 172.21.15.103:0/1537976897 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc017070 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.579+0000 7f3fcf7fe640 1 -- 172.21.15.103:0/1537976897 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc005ce0 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.579+0000 7f3fcf7fe640 1 -- 172.21.15.103:0/1537976897 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc007310 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.579+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe806d640 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.579+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe81f3c90 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.580+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe815c670 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.580+0000 7f3fcf7fe640 1 -- 172.21.15.103:0/1537976897 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3fdc01a070 con 0x7f3fe81530a0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.581+0000 7f3fcf7fe640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fd406c2b0 0x7f3fd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.581+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fd406c2b0 0x7f3fd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.581+0000 7f3fcf7fe640 1 -- 172.21.15.103:0/1537976897 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3fdc08ab60 con 0x7f3fe81530a0 2024-09-19T05:40:07.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.581+0000 7f3fe6d9d640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fd406c2b0 0x7f3fd406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8034000 tx=0x7f3fd802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.585+0000 7f3fcf7fe640 1 -- 172.21.15.103:0/1537976897 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3fdc058910 con 0x7f3fe81530a0 2024-09-19T05:40:07.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.825+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3fe8150090 con 0x7f3fe81530a0 2024-09-19T05:40:07.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.825+0000 7f3fcf7fe640 1 -- 172.21.15.103:0/1537976897 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f3fdc05cc10 con 0x7f3fe81530a0 2024-09-19T05:40:07.827 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:40:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fd406c2b0 msgr2=0x7f3fd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fd406c2b0 0x7f3fd406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8034000 tx=0x7f3fd802e000 comp rx=0 tx=0).stop 2024-09-19T05:40:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe81530a0 msgr2=0x7f3fe80cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe81530a0 0x7f3fe80cc670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c430 tx=0x7f3fdc00c8f0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 shutdown_connections 2024-09-19T05:40:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fd406c2b0 0x7f3fd406e770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe815cd80 0x7f3fe8143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe81530a0 0x7f3fe80cc670 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 --2- 172.21.15.103:0/1537976897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe8152cc0 0x7f3fe806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.827+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 >> 172.21.15.103:0/1537976897 conn(0x7f3fe806f910 msgr2=0x7f3fe80cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.828+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 shutdown_connections 2024-09-19T05:40:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.828+0000 7f3fed1bd640 1 -- 172.21.15.103:0/1537976897 wait complete. 2024-09-19T05:40:07.840 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T05:40:07.840 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T05:40:07.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T05:40:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.939+0000 7f220f93b640 1 Processor -- start 2024-09-19T05:40:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.939+0000 7f220f93b640 1 -- start start 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220f93b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 0x7f22080c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220f93b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f22080c46c0 0x7f2208158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220f93b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220f93b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f22081585a0 con 0x7f22080c46c0 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220f93b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f220815bc80 con 0x7f2208151ea0 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220f93b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2208157c70 con 0x7f2208159510 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f22080c46c0 0x7f2208158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f22080c46c0 0x7f2208158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52160/0 (socket says 172.21.15.103:52160) 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 -- 172.21.15.103:0/1127942337 learned_addr learned my addr 172.21.15.103:0/1127942337 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220d6d7640 1 --2- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 0x7f22080c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ded8640 1 --2- 172.21.15.103:0/1127942337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220d6d7640 1 -- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 msgr2=0x7f22080c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220d6d7640 1 -- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 msgr2=0x7f22080c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 -- 172.21.15.103:0/1127942337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 msgr2=0x7f220806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220d6d7640 1 --2- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 0x7f22080c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 --2- 172.21.15.103:0/1127942337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 -- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 msgr2=0x7f22080c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220d6d7640 1 --2- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 0x7f22080c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 --2- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 0x7f22080c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ced6640 1 -- 172.21.15.103:0/1127942337 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2208157f50 con 0x7f22080c46c0 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.940+0000 7f220ded8640 1 --2- 172.21.15.103:0/1127942337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.941+0000 7f220ced6640 1 --2- 172.21.15.103:0/1127942337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f2208158fd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f220806fd40 tx=0x7f21f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eb305e47bd0d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.941+0000 7f21fffff640 1 -- 172.21.15.103:0/1127942337 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8037070 con 0x7f22080c46c0 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.941+0000 7f21fffff640 1 -- 172.21.15.103:0/1127942337 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f8032440 con 0x7f22080c46c0 2024-09-19T05:40:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.941+0000 7f21fffff640 1 -- 172.21.15.103:0/1127942337 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8032810 con 0x7f22080c46c0 2024-09-19T05:40:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.941+0000 7f220f93b640 1 -- 172.21.15.103:0/1127942337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 msgr2=0x7f2208158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.941+0000 7f220f93b640 1 --2- 172.21.15.103:0/1127942337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f2208158fd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f220806fd40 tx=0x7f21f802a270 comp rx=0 tx=0).stop 2024-09-19T05:40:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.942+0000 7f220f93b640 1 -- 172.21.15.103:0/1127942337 shutdown_connections 2024-09-19T05:40:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.942+0000 7f220f93b640 1 --2- 172.21.15.103:0/1127942337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.942+0000 7f220f93b640 1 --2- 172.21.15.103:0/1127942337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f2208158fd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.942+0000 7f220f93b640 1 --2- 172.21.15.103:0/1127942337 >> v2:172.21.15.174:3300/0 conn(0x7f2208151ea0 0x7f22080c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.942+0000 7f220f93b640 1 -- 172.21.15.103:0/1127942337 >> 172.21.15.103:0/1127942337 conn(0x7f22080c9230 msgr2=0x7f22080c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.942+0000 7f220f93b640 1 -- 172.21.15.103:0/1127942337 shutdown_connections 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.942+0000 7f220f93b640 1 -- 172.21.15.103:0/1127942337 wait complete. 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 Processor -- start 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 -- start start 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f22081ec630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 0x7f22081e2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2208158a30 con 0x7f22080c46c0 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2208152280 con 0x7f2208151ea0 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220f93b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f220815bf20 con 0x7f2208159510 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220d6d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f22081ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220d6d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f22081ec630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52166/0 (socket says 172.21.15.103:52166) 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.943+0000 7f220d6d7640 1 -- 172.21.15.103:0/929155656 learned_addr learned my addr 172.21.15.103:0/929155656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220ded8640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220ced6640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 0x7f22081e2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220ced6640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 msgr2=0x7f22081e2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220ced6640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 msgr2=0x7f22081e2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220ced6640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 0x7f22081e2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220ced6640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 0x7f22081e2aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220d6d7640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 msgr2=0x7f220815ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220d6d7640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2208159510 0x7f220815ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220d6d7640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 msgr2=0x7f22081e2aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220d6d7640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2208151ea0 0x7f22081e2aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220d6d7640 1 -- 172.21.15.103:0/929155656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220815b3b0 con 0x7f22080c46c0 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220d6d7640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f22081ec630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2204007ef0 tx=0x7f220400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204014620 con 0x7f22080c46c0 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2204019070 con 0x7f22080c46c0 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2208159d60 con 0x7f22080c46c0 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204014a00 con 0x7f22080c46c0 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.944+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22081f0930 con 0x7f22080c46c0 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.945+0000 7f220f93b640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22081e2220 0x7f220815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.945+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22080c3a50 con 0x7f22081e2220 2024-09-19T05:40:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.945+0000 7f220ced6640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22081e2220 0x7f220815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f220ced6640 1 -- 172.21.15.103:0/929155656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f220814d0a0 con 0x7f22081e2220 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2204014ba0 con 0x7f22080c46c0 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f220ced6640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22081e2220 0x7f220815b580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22080c3690 tx=0x7f21f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f21ec06c2b0 0x7f21ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f220408c0b0 con 0x7f22080c46c0 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f220ded8640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f21ec06c2b0 0x7f21ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8041070 con 0x7f22081e2220 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f21f803c660 con 0x7f22081e2220 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22081e2220 msgr2=0x7f220815b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22081e2220 0x7f220815b580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22080c3690 tx=0x7f21f80046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22081e2220 msgr2=0x7f220815b580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.946+0000 7f21fdffb640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22081e2220 0x7f220815b580 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22080c3690 tx=0x7f21f80046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.947+0000 7f220ded8640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f21ec06c2b0 0x7f21ec06e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f22080c3640 tx=0x7f2200008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f220f93b640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080cb610 0x7f22081e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22081f0b00 con 0x7f22080cb610 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f220ced6640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080cb610 0x7f22081e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f220ced6640 1 -- 172.21.15.103:0/929155656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2208159240 con 0x7f22080cb610 2024-09-19T05:40:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f220ced6640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080cb610 0x7f22081e0ea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f22081e2930 tx=0x7f21f8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8037040 con 0x7f22080cb610 2024-09-19T05:40:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7f21f8009490 con 0x7f22080cb610 2024-09-19T05:40:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080cb610 msgr2=0x7f22081e0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f21fdffb640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080cb610 0x7f22081e0ea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f22081e2930 tx=0x7f21f8008030 comp rx=0 tx=0).stop 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f21fdffb640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080cb610 msgr2=0x7f22081e0ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.953+0000 7f21fdffb640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080cb610 0x7f22081e0ea0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 168085, 2024-09-19T05:40:07.956 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:07.957 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:07.958 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:40:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:40:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:07.961 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.963 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:07.964 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:07.965 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.966 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-19T05:40:07.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.969 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:40:07.970 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:07.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f21ec06c2b0 msgr2=0x7f21ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f21ec06c2b0 0x7f21ec06e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f22080c3640 tx=0x7f2200008040 comp rx=0 tx=0).stop 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 msgr2=0x7f22081ec630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 --2- 172.21.15.103:0/929155656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22080c46c0 0x7f22081ec630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2204007ef0 tx=0x7f220400e4b0 comp rx=0 tx=0).stop 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220ded8640 1 -- 172.21.15.103:0/929155656 reap_dead start 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220ded8640 1 -- 172.21.15.103:0/929155656 reap_dead start 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 shutdown_connections 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 >> 172.21.15.103:0/929155656 conn(0x7f22080c9230 msgr2=0x7f2208150210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 shutdown_connections 2024-09-19T05:40:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:07.954+0000 7f220f93b640 1 -- 172.21.15.103:0/929155656 wait complete. 2024-09-19T05:40:07.972 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:40:07.973 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T05:40:07.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T05:40:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.072+0000 7f37c795b640 1 Processor -- start 2024-09-19T05:40:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.072+0000 7f37c795b640 1 -- start start 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c795b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f37c015eae0 0x7f37c00c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c795b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 0x7f37c0072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c795b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c00cb060 con 0x7f37c0155040 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c795b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f37c006cc80 con 0x7f37c015eae0 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c795b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f37c015ef70 con 0x7f37c0073960 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c4ef6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f37c015eae0 0x7f37c00c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c56f7640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f37c0155040 0x7f37c015e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44642/0 (socket says 172.21.15.103:44642) 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c56f7640 1 -- 172.21.15.103:0/1601773779 learned_addr learned my addr 172.21.15.103:0/1601773779 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c5ef8640 1 --2- 172.21.15.103:0/1601773779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 0x7f37c0072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37b7fff640 1 -- 172.21.15.103:0/1601773779 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335615709 0 0) 0x7f37c00cb060 con 0x7f37c0155040 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37b7fff640 1 -- 172.21.15.103:0/1601773779 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37ac003520 con 0x7f37c0155040 2024-09-19T05:40:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c4ef6640 1 -- 172.21.15.103:0/1601773779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 msgr2=0x7f37c0072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:08.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c4ef6640 1 --2- 172.21.15.103:0/1601773779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 0x7f37c0072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c4ef6640 1 -- 172.21.15.103:0/1601773779 >> v1:172.21.15.103:6789/0 conn(0x7f37c0155040 legacy=0x7f37c015e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.073+0000 7f37c4ef6640 1 -- 172.21.15.103:0/1601773779 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c00742d0 con 0x7f37c015eae0 2024-09-19T05:40:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.074+0000 7f37c4ef6640 1 --2- 172.21.15.103:0/1601773779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c015eae0 0x7f37c00c8040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f37b00097a0 tx=0x7f37b002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8de2abe6024c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.074+0000 7f37b7fff640 1 -- 172.21.15.103:0/1601773779 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0037070 con 0x7f37c015eae0 2024-09-19T05:40:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.074+0000 7f37b7fff640 1 -- 172.21.15.103:0/1601773779 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b0032440 con 0x7f37c015eae0 2024-09-19T05:40:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.074+0000 7f37b7fff640 1 -- 172.21.15.103:0/1601773779 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0032810 con 0x7f37c015eae0 2024-09-19T05:40:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 -- 172.21.15.103:0/1601773779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c015eae0 msgr2=0x7f37c00c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 --2- 172.21.15.103:0/1601773779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c015eae0 0x7f37c00c8040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f37b00097a0 tx=0x7f37b002a210 comp rx=0 tx=0).stop 2024-09-19T05:40:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 -- 172.21.15.103:0/1601773779 shutdown_connections 2024-09-19T05:40:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 --2- 172.21.15.103:0/1601773779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 0x7f37c0072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 --2- 172.21.15.103:0/1601773779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c015eae0 0x7f37c00c8040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 -- 172.21.15.103:0/1601773779 >> 172.21.15.103:0/1601773779 conn(0x7f37c00ca140 msgr2=0x7f37c00ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 -- 172.21.15.103:0/1601773779 shutdown_connections 2024-09-19T05:40:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.075+0000 7f37c795b640 1 -- 172.21.15.103:0/1601773779 wait complete. 2024-09-19T05:40:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.076+0000 7f37c795b640 1 Processor -- start 2024-09-19T05:40:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.076+0000 7f37c795b640 1 -- start start 2024-09-19T05:40:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.076+0000 7f37c795b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 0x7f37c014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c795b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 0x7f37c01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c795b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c014e4c0 0x7f37c01f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c795b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0073f90 con 0x7f37c014e4c0 2024-09-19T05:40:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c795b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f37c006c9a0 con 0x7f37c0155040 2024-09-19T05:40:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c795b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f37c015f250 con 0x7f37c0073960 2024-09-19T05:40:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c014e4c0 0x7f37c01f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c014e4c0 0x7f37c01f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52210/0 (socket says 172.21.15.103:52210) 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 -- 172.21.15.103:0/3836214188 learned_addr learned my addr 172.21.15.103:0/3836214188 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 0x7f37c014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c4ef6640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 0x7f37c01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c4ef6640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 msgr2=0x7f37c01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c4ef6640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 msgr2=0x7f37c01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c4ef6640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 0x7f37c01595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c4ef6640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 0x7f37c01595e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 msgr2=0x7f37c014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c0073960 0x7f37c014dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 msgr2=0x7f37c01595e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0155040 0x7f37c01595e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c014d270 con 0x7f37c014e4c0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c5ef8640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c014e4c0 0x7f37c01f4d30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009e30 tx=0x7f37b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8018020 con 0x7f37c014e4c0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8014480 con 0x7f37c014e4c0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c01f5730 con 0x7f37c014e4c0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.077+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8014870 con 0x7f37c014e4c0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.078+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c014ccf0 con 0x7f37c014e4c0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.078+0000 7f37c795b640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.078+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f37c006d230 con 0x7f37c01f5270 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.078+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.079+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.079+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.079+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.079+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:40:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.079+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37b8005d10 con 0x7f37c014e4c0 2024-09-19T05:40:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.079+0000 7f37b5ffb640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f37a406c2b0 0x7f37a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.080+0000 7f37c4ef6640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f37a406c2b0 0x7f37a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.080+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f37b808c590 con 0x7f37c014e4c0 2024-09-19T05:40:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.080+0000 7f37c4ef6640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f37a406c2b0 0x7f37a406e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37b0034000 tx=0x7f37b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.280+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.280+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:40:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.280+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.280+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:08.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.280+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:40:08.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.681+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:08.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.681+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:40:08.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.681+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:08.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.681+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:08.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:08.681+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:40:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:09.483+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:09.483+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:40:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:09.483+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:09.483+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:09.483+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:40:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:11.084+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:11.084+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:11.084+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:11.084+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:11.084+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37b4ff9640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37b4ff9640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37b4ff9640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37b4ff9640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 msgr2=0x7f37c0149eb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37b4ff9640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c01f5270 0x7f37c0149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37b4ff9640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3798006080 con 0x7f3798003540 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 msgr2=0x7f37980059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:40:12.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 msgr2=0x7f37980059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:12.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:12.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.076+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:40:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.277+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.277+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 msgr2=0x7f37980059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T05:40:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.277+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 msgr2=0x7f37980059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:40:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.277+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:40:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.277+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:40:12.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.678+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.679+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3798006230 con 0x7f3798003540 2024-09-19T05:40:12.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.679+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f60 tx=0x7f37bc017af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.679+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc001660 con 0x7f3798003540 2024-09-19T05:40:12.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.680+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f37bc001660 con 0x7f3798003540 2024-09-19T05:40:12.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.680+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 msgr2=0x7f37980059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.680+0000 7f37b5ffb640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f60 tx=0x7f37bc017af0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.680+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 msgr2=0x7f37980059d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:40:12.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.680+0000 7f37b5ffb640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3798003540 0x7f37980059d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.687+0000 7f37c795b640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c015e9d0 0x7f37c014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.687+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0155420 con 0x7f37c015e9d0 2024-09-19T05:40:12.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.687+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c015e9d0 0x7f37c014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.687+0000 7f37c56f7640 1 -- 172.21.15.103:0/3836214188 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f37c00744a0 con 0x7f37c015e9d0 2024-09-19T05:40:12.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37c56f7640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c015e9d0 0x7f37c014a3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f60 tx=0x7f37bc000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc021470 con 0x7f37c015e9d0 2024-09-19T05:40:12.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 <== mon.1 v2:172.21.15.174:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f37bc021470 con 0x7f37c015e9d0 2024-09-19T05:40:12.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c015e9d0 msgr2=0x7f37c014a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37b5ffb640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c015e9d0 0x7f37c014a3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f60 tx=0x7f37bc000ed0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37b5ffb640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c015e9d0 msgr2=0x7f37c014a3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:40:12.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37b5ffb640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c015e9d0 0x7f37c014a3f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.688+0000 7f37c5ef8640 1 -- 172.21.15.103:0/3836214188 reap_dead start 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 5125, 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:40:12.692 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 4, 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:12.693 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:12.694 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:40:12.696 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:40:12.697 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:12.698 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:12.699 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:12.699 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:12.699 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:12.699 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:12.699 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:12.699 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:12.699 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:40:12.700 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:40:12.701 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:12.702 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:12.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.704 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:40:12.704 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:40:12.704 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:12.704 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:12.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.705 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:12.705 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:40:12.705 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.705 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:40:12.706 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:40:12.707 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:12.708 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:40:12.709 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:40:12.710 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f37a406c2b0 msgr2=0x7f37a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f37a406c2b0 0x7f37a406e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37b0034000 tx=0x7f37b002e000 comp rx=0 tx=0).stop 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c014e4c0 msgr2=0x7f37c01f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c014e4c0 0x7f37c01f4d30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009e30 tx=0x7f37b800c490 comp rx=0 tx=0).stop 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 shutdown_connections 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f37a406c2b0 0x7f37a406e770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 --2- 172.21.15.103:0/3836214188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37c014e4c0 0x7f37c01f4d30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 >> 172.21.15.103:0/3836214188 conn(0x7f37c00ca140 msgr2=0x7f37c0075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 shutdown_connections 2024-09-19T05:40:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.689+0000 7f37c795b640 1 -- 172.21.15.103:0/3836214188 wait complete. 2024-09-19T05:40:12.713 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:40:12.713 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T05:40:12.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T05:40:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.819+0000 7f79cf991640 1 Processor -- start 2024-09-19T05:40:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.820+0000 7f79cf991640 1 -- start start 2024-09-19T05:40:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.820+0000 7f79cf991640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f79c8155040 0x7f79c80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.820+0000 7f79cf991640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c80cbed0 con 0x7f79c80b3540 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.820+0000 7f79cf991640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c815bd70 con 0x7f79c80c5950 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.820+0000 7f79cf991640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f79c80cbbf0 con 0x7f79c8155040 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.820+0000 7f79ccf2c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f79c80b3540 0x7f79c815e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56916/0 (socket says 172.21.15.103:56916) 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.820+0000 7f79ccf2c640 1 -- 172.21.15.103:0/1146615850 learned_addr learned my addr 172.21.15.103:0/1146615850 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080297477 0 0) 0x7f79c80cbed0 con 0x7f79c80b3540 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79b4003520 con 0x7f79c80b3540 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cd72d640 1 --2- 172.21.15.103:0/1146615850 >> v2:172.21.15.174:3300/0 conn(0x7f79c8155040 0x7f79c80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1848358599 0 0) 0x7f79b4003520 con 0x7f79c80b3540 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 >> v2:172.21.15.174:3300/0 conn(0x7f79c8155040 msgr2=0x7f79c80cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 --2- 172.21.15.103:0/1146615850 >> v2:172.21.15.174:3300/0 conn(0x7f79c8155040 0x7f79c80cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 >> v1:172.21.15.174:6789/0 conn(0x7f79c80c5950 legacy=0x7f79c80cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c815afb0 con 0x7f79c80b3540 2024-09-19T05:40:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f79b8001670 con 0x7f79c80b3540 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 >> v1:172.21.15.103:6789/0 conn(0x7f79c80b3540 legacy=0x7f79c815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79b4003a00 0x7f79b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4004800 0x7f79b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79b4005210 0x7f79b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79c80cbbf0 con 0x7f79b4003a00 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79b400c120 con 0x7f79b4005210 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f79b400c320 con 0x7f79b4004800 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cd72d640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79b4003a00 0x7f79b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79ccf2c640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4004800 0x7f79b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cdf2e640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79b4005210 0x7f79b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cd72d640 1 -- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4004800 msgr2=0x7f79b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cd72d640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4004800 0x7f79b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cd72d640 1 -- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79b4005210 msgr2=0x7f79b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cd72d640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79b4005210 0x7f79b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cd72d640 1 -- 172.21.15.103:0/1146615850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b4003520 con 0x7f79b4003a00 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cdf2e640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79b4005210 0x7f79b400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79ccf2c640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4004800 0x7f79b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.821+0000 7f79cdf2e640 1 -- 172.21.15.103:0/1146615850 reap_dead start 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.822+0000 7f79cd72d640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79b4003a00 0x7f79b4003e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f79c400ba30 tx=0x7f79b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9352e65a03a3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.822+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4030070 con 0x7f79b4003a00 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.822+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c402ade0 con 0x7f79b4003a00 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.822+0000 7f79bffff640 1 -- 172.21.15.103:0/1146615850 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400b600 con 0x7f79b4003a00 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.823+0000 7f79cf991640 1 -- 172.21.15.103:0/1146615850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79b4003a00 msgr2=0x7f79b4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.823+0000 7f79cf991640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79b4003a00 0x7f79b4003e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f79c400ba30 tx=0x7f79b4005830 comp rx=0 tx=0).stop 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.823+0000 7f79cf991640 1 -- 172.21.15.103:0/1146615850 shutdown_connections 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.823+0000 7f79cf991640 1 --2- 172.21.15.103:0/1146615850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79b4003a00 0x7f79b4003e00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.823+0000 7f79cf991640 1 -- 172.21.15.103:0/1146615850 >> 172.21.15.103:0/1146615850 conn(0x7f79c8073340 msgr2=0x7f79c8073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:12.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.823+0000 7f79cf991640 1 -- 172.21.15.103:0/1146615850 shutdown_connections 2024-09-19T05:40:12.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.823+0000 7f79cf991640 1 -- 172.21.15.103:0/1146615850 wait complete. 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.824+0000 7f79cf991640 1 Processor -- start 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.824+0000 7f79cf991640 1 -- start start 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cf991640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4003a00 0x7f79c80c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cf991640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c80cfe40 0x7f79c80b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cf991640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c81f0e20 0x7f79c81f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cf991640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79c815b850 con 0x7f79c81f0e20 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cf991640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79c815b570 con 0x7f79c80cfe40 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cf991640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f79c80cb540 con 0x7f79b4003a00 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c81f0e20 0x7f79c81f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c81f0e20 0x7f79c81f12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47518/0 (socket says 172.21.15.103:47518) 2024-09-19T05:40:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 -- 172.21.15.103:0/3090448145 learned_addr learned my addr 172.21.15.103:0/3090448145 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cd72d640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4003a00 0x7f79c80c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79ccf2c640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c80cfe40 0x7f79c80b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4003a00 msgr2=0x7f79c80c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b4003a00 0x7f79c80c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c80cfe40 msgr2=0x7f79c80b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c80cfe40 0x7f79c80b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 -- 172.21.15.103:0/3090448145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c80d0380 con 0x7f79c81f0e20 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79ccf2c640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c80cfe40 0x7f79c80b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79cdf2e640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c81f0e20 0x7f79c81f12a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f79c80ce3a0 tx=0x7f79c000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.825+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0006b50 con 0x7f79c81f0e20 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.826+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c0006cf0 con 0x7f79c81f0e20 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.826+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c81f4530 con 0x7f79c81f0e20 2024-09-19T05:40:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.826+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0004b00 con 0x7f79c81f0e20 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.826+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c81f4af0 con 0x7f79c81f0e20 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.827+0000 7f79cf991640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c814b2a0 0x7f79c814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.827+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f79c81f52d0 con 0x7f79c814b2a0 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.827+0000 7f79cd72d640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c814b2a0 0x7f79c814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.827+0000 7f79cd72d640 1 -- 172.21.15.103:0/3090448145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79c81541d0 con 0x7f79c814b2a0 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.827+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f79c0004ca0 con 0x7f79c81f0e20 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79cd72d640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c814b2a0 0x7f79c814b680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f79c4032000 tx=0x7f79c4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f79ac06c2b0 0x7f79ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f79c008b110 con 0x7f79c81f0e20 2024-09-19T05:40:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79ccf2c640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f79ac06c2b0 0x7f79ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4044070 con 0x7f79c814b2a0 2024-09-19T05:40:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f79c4004020 con 0x7f79c814b2a0 2024-09-19T05:40:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c814b2a0 msgr2=0x7f79c814b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c814b2a0 0x7f79c814b680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f79c4032000 tx=0x7f79c4004730 comp rx=0 tx=0).stop 2024-09-19T05:40:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c814b2a0 msgr2=0x7f79c814b680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:40:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79bdffb640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c814b2a0 0x7f79c814b680 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.828+0000 7f79ccf2c640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f79ac06c2b0 0x7f79ac06e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79c8154010 tx=0x7f79b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.834+0000 7f79cf991640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8158c80 0x7f79c8159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.834+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f79c80c5d60 con 0x7f79c8158c80 2024-09-19T05:40:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79cd72d640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8158c80 0x7f79c8159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79cd72d640 1 -- 172.21.15.103:0/3090448145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f79c80cb8d0 con 0x7f79c8158c80 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79cd72d640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8158c80 0x7f79c8159060 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79c815f410 tx=0x7f79c4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c403d420 con 0x7f79c8158c80 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 <== mon.2 v2:172.21.15.174:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7f79c403d420 con 0x7f79c8158c80 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8158c80 msgr2=0x7f79c8159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79bdffb640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8158c80 0x7f79c8159060 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79c815f410 tx=0x7f79c4008040 comp rx=0 tx=0).stop 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79bdffb640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8158c80 msgr2=0x7f79c8159060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T05:40:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.835+0000 7f79bdffb640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8158c80 0x7f79c8159060 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79c815f410 tx=0x7f79c4008040 comp rx=0 tx=0).stop 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 57425, 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-19T05:40:12.839 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 5, 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:12.840 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:12.841 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "a5534b78-3424-4071-a9f5-ce5e90eb5cb1", 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-19T05:36:43.871228Z", 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-19T05:40:12.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-19T05:40:12.843 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-19T05:40:12.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-19T05:40:12.845 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-19T05:40:12.846 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3300", 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789", 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.847 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6789/0", 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6789/0", 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-19T05:40:12.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:3301", 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790", 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.174:6790/0", 2024-09-19T05:40:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.174:6790/0", 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:40:12.850 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-19T05:40:12.851 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-19T05:40:12.852 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-19T05:40:12.852 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-19T05:40:12.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-19T05:40:12.852 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-19T05:40:12.852 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:12.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f79ac06c2b0 msgr2=0x7f79ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f79ac06c2b0 0x7f79ac06e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79c8154010 tx=0x7f79b8009040 comp rx=0 tx=0).stop 2024-09-19T05:40:12.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c81f0e20 msgr2=0x7f79c81f12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cdf2e640 1 -- 172.21.15.103:0/3090448145 reap_dead start 2024-09-19T05:40:12.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c81f0e20 0x7f79c81f12a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f79c80ce3a0 tx=0x7f79c000eb90 comp rx=0 tx=0).stop 2024-09-19T05:40:12.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 shutdown_connections 2024-09-19T05:40:12.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 --2- 172.21.15.103:0/3090448145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c81f0e20 0x7f79c81f12a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 >> 172.21.15.103:0/3090448145 conn(0x7f79c8073340 msgr2=0x7f79c80cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:12.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 shutdown_connections 2024-09-19T05:40:12.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.836+0000 7f79cf991640 1 -- 172.21.15.103:0/3090448145 wait complete. 2024-09-19T05:40:12.854 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T05:40:12.854 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T05:40:12.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T05:40:12.855 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:12.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.953+0000 7fbaab48b640 1 Processor -- start 2024-09-19T05:40:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.953+0000 7fbaab48b640 1 -- start start 2024-09-19T05:40:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fbaab48b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 0x7fbaa40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fbaab48b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa40cbed0 con 0x7fbaa40b3540 2024-09-19T05:40:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fbaab48b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa415bd70 con 0x7fbaa4155040 2024-09-19T05:40:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fbaab48b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa40cbbf0 con 0x7fbaa40c5950 2024-09-19T05:40:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fbaa8a26640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbaa40b3540 0x7fbaa40cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56920/0 (socket says 172.21.15.103:56920) 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fbaa8a26640 1 -- 172.21.15.103:0/2776498041 learned_addr learned my addr 172.21.15.103:0/2776498041 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645598595 0 0) 0x7fbaa40cbed0 con 0x7fbaa40b3540 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba90003520 con 0x7fbaa40b3540 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.954+0000 7fbaa9a28640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 0x7fbaa40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2571116353 0 0) 0x7fba90003520 con 0x7fbaa40b3540 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 msgr2=0x7fbaa40cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 0x7fbaa40cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 >> v1:172.21.15.174:6789/0 conn(0x7fbaa4155040 legacy=0x7fbaa415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa415afb0 con 0x7fbaa40b3540 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fba94001670 con 0x7fbaa40b3540 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 >> v1:172.21.15.103:6789/0 conn(0x7fbaa40b3540 legacy=0x7fbaa40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 0x7fba900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba90003f60 0x7fba90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fba900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa40cbbf0 con 0x7fba90004d40 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba9000baa0 con 0x7fba90003f60 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fba9000bca0 con 0x7fbaa40c5950 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9a28640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fba900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa8a26640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba90003f60 0x7fba90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9227640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 0x7fba900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9a28640 1 -- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 msgr2=0x7fba900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9a28640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 0x7fba900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9a28640 1 -- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba90003f60 msgr2=0x7fba90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9a28640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba90003f60 0x7fba90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9a28640 1 -- 172.21.15.103:0/2776498041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba90003520 con 0x7fba90004d40 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.955+0000 7fbaa9227640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c5950 0x7fba900039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fbaa9a28640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fba900051c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009fc0 tx=0x7fba90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f153fbc3bc1fdc56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c009c10 con 0x7fba90004d40 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba9c036070 con 0x7fba90004d40 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fba9bfff640 1 -- 172.21.15.103:0/2776498041 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c031880 con 0x7fba90004d40 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fbaab48b640 1 -- 172.21.15.103:0/2776498041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 msgr2=0x7fba900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fbaab48b640 1 --2- 172.21.15.103:0/2776498041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fba900051c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009fc0 tx=0x7fba90005830 comp rx=0 tx=0).stop 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fbaa9a28640 1 -- 172.21.15.103:0/2776498041 reap_dead start 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fbaab48b640 1 -- 172.21.15.103:0/2776498041 shutdown_connections 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.956+0000 7fbaab48b640 1 -- 172.21.15.103:0/2776498041 >> 172.21.15.103:0/2776498041 conn(0x7fbaa4073340 msgr2=0x7fbaa4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.957+0000 7fbaab48b640 1 -- 172.21.15.103:0/2776498041 shutdown_connections 2024-09-19T05:40:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.957+0000 7fbaab48b640 1 -- 172.21.15.103:0/2776498041 wait complete. 2024-09-19T05:40:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 Processor -- start 2024-09-19T05:40:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 -- start start 2024-09-19T05:40:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fbaa40b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa415ca80 0x7fbaa40c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c9e10 0x7fbaa414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa415b850 con 0x7fba90004d40 2024-09-19T05:40:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa415b570 con 0x7fbaa415ca80 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaab48b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa415eb30 con 0x7fbaa40c9e10 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaa9227640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fbaa40b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaa9227640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fbaa40b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47532/0 (socket says 172.21.15.103:47532) 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.958+0000 7fbaa9227640 1 -- 172.21.15.103:0/617681481 learned_addr learned my addr 172.21.15.103:0/617681481 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaa9a28640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c9e10 0x7fbaa414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaa9227640 1 -- 172.21.15.103:0/617681481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c9e10 msgr2=0x7fbaa414b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaa9227640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c9e10 0x7fbaa414b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaa9227640 1 -- 172.21.15.103:0/617681481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa415ca80 msgr2=0x7fbaa40c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaa9227640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa415ca80 0x7fbaa40c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaa9227640 1 -- 172.21.15.103:0/617681481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa415cfe0 con 0x7fba90004d40 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaa9227640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fbaa40b6040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000e660 tx=0x7fbaa000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fba99ffb640 1 -- 172.21.15.103:0/617681481 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00050d0 con 0x7fba90004d40 2024-09-19T05:40:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fba99ffb640 1 -- 172.21.15.103:0/617681481 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0018070 con 0x7fba90004d40 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa40d0360 con 0x7fba90004d40 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fba99ffb640 1 -- 172.21.15.103:0/617681481 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000c660 con 0x7fba90004d40 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.959+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa40ca990 con 0x7fba90004d40 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.960+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa40cb540 con 0x7fba90004d40 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.960+0000 7fba99ffb640 1 -- 172.21.15.103:0/617681481 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbaa000c800 con 0x7fba90004d40 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.961+0000 7fba99ffb640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fba8806c2e0 0x7fba8806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.961+0000 7fbaa8a26640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fba8806c2e0 0x7fba8806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.961+0000 7fba99ffb640 1 -- 172.21.15.103:0/617681481 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbaa008b4c0 con 0x7fba90004d40 2024-09-19T05:40:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.962+0000 7fbaa8a26640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fba8806c2e0 0x7fba8806e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fba94001050 tx=0x7fba94001150 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:12.966+0000 7fba99ffb640 1 -- 172.21.15.103:0/617681481 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbaa0059830 con 0x7fba90004d40 2024-09-19T05:40:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.195+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fbaa40b4100 con 0x7fba90004d40 2024-09-19T05:40:13.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.196+0000 7fba99ffb640 1 -- 172.21.15.103:0/617681481 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fbaa0059130 con 0x7fba90004d40 2024-09-19T05:40:13.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fba8806c2e0 msgr2=0x7fba8806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fba8806c2e0 0x7fba8806e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fba94001050 tx=0x7fba94001150 comp rx=0 tx=0).stop 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 msgr2=0x7fbaa40b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fbaa40b6040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000e660 tx=0x7fbaa000eb20 comp rx=0 tx=0).stop 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 shutdown_connections 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fba8806c2e0 0x7fba8806e7a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaa40c9e10 0x7fbaa414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa415ca80 0x7fbaa40c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 --2- 172.21.15.103:0/617681481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba90004d40 0x7fbaa40b6040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 >> 172.21.15.103:0/617681481 conn(0x7fbaa4073340 msgr2=0x7fbaa40cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 shutdown_connections 2024-09-19T05:40:13.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:13.198+0000 7fbaab48b640 1 -- 172.21.15.103:0/617681481 wait complete. 2024-09-19T05:40:13.212 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T05:40:23.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:40:23.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.321+0000 7f78d8d2a640 1 Processor -- start 2024-09-19T05:40:23.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.322+0000 7f78d8d2a640 1 -- start start 2024-09-19T05:40:23.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.322+0000 7f78d8d2a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78d4155040 0x7f78d40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d8d2a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f78d40c5950 0x7f78d40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d8d2a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d40cbed0 con 0x7f78d40b3540 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d8d2a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f78d415bd70 con 0x7f78d4155040 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d8d2a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f78d40cbbf0 con 0x7f78d40c5950 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78d4155040 0x7f78d40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78d4155040 0x7f78d40cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39656/0 (socket says 172.21.15.103:39656) 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d259c640 1 -- 172.21.15.103:0/3764062664 learned_addr learned my addr 172.21.15.103:0/3764062664 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d2d9d640 1 --2- 172.21.15.103:0/3764062664 >> v2:172.21.15.174:3300/0 conn(0x7f78d40c5950 0x7f78d40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d259c640 1 -- 172.21.15.103:0/3764062664 >> v2:172.21.15.174:3300/0 conn(0x7f78d40c5950 msgr2=0x7f78d40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d259c640 1 --2- 172.21.15.103:0/3764062664 >> v2:172.21.15.174:3300/0 conn(0x7f78d40c5950 0x7f78d40cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d259c640 1 -- 172.21.15.103:0/3764062664 >> v1:172.21.15.174:6789/0 conn(0x7f78d40b3540 legacy=0x7f78d415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:23.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.323+0000 7f78d259c640 1 -- 172.21.15.103:0/3764062664 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d415afb0 con 0x7f78d4155040 2024-09-19T05:40:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d259c640 1 --2- 172.21.15.103:0/3764062664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d4155040 0x7f78d40cb540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f78d4158a00 tx=0x7f78c402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c47ff44c4a35ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d159a640 1 -- 172.21.15.103:0/3764062664 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4037070 con 0x7f78d4155040 2024-09-19T05:40:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d159a640 1 -- 172.21.15.103:0/3764062664 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c402ae50 con 0x7f78d4155040 2024-09-19T05:40:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d159a640 1 -- 172.21.15.103:0/3764062664 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4032860 con 0x7f78d4155040 2024-09-19T05:40:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d8d2a640 1 -- 172.21.15.103:0/3764062664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d4155040 msgr2=0x7f78d40cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/3764062664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d4155040 0x7f78d40cb540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f78d4158a00 tx=0x7f78c402a300 comp rx=0 tx=0).stop 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d8d2a640 1 -- 172.21.15.103:0/3764062664 shutdown_connections 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/3764062664 >> v2:172.21.15.174:3300/0 conn(0x7f78d40c5950 0x7f78d40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/3764062664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d4155040 0x7f78d40cb540 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.324+0000 7f78d8d2a640 1 -- 172.21.15.103:0/3764062664 >> 172.21.15.103:0/3764062664 conn(0x7f78d4073340 msgr2=0x7f78d4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.325+0000 7f78d8d2a640 1 -- 172.21.15.103:0/3764062664 shutdown_connections 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.325+0000 7f78d8d2a640 1 -- 172.21.15.103:0/3764062664 wait complete. 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.326+0000 7f78d8d2a640 1 Processor -- start 2024-09-19T05:40:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.326+0000 7f78d8d2a640 1 -- start start 2024-09-19T05:40:23.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d40b3540 0x7f78d40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d40c5950 0x7f78d41f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78d4155040 0x7f78d41f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78d415b850 con 0x7f78d40c5950 2024-09-19T05:40:23.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78d415b570 con 0x7f78d40b3540 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f78d415eb30 con 0x7f78d4155040 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d40c5950 0x7f78d41f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d40c5950 0x7f78d41f4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39658/0 (socket says 172.21.15.103:39658) 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 -- 172.21.15.103:0/2330300085 learned_addr learned my addr 172.21.15.103:0/2330300085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d259c640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d40b3540 0x7f78d40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d2d9d640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78d4155040 0x7f78d41f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 -- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78d4155040 msgr2=0x7f78d41f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78d4155040 0x7f78d41f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 -- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d40b3540 msgr2=0x7f78d40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d40b3540 0x7f78d40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 -- 172.21.15.103:0/2330300085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d40ca040 con 0x7f78d40c5950 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d1d9b640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d40c5950 0x7f78d41f4dd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c400 tx=0x7f78bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78caffd640 1 -- 172.21.15.103:0/2330300085 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0052d0 con 0x7f78d40c5950 2024-09-19T05:40:23.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78caffd640 1 -- 172.21.15.103:0/2330300085 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78bc005490 con 0x7f78d40c5950 2024-09-19T05:40:23.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d40ca300 con 0x7f78d40c5950 2024-09-19T05:40:23.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78caffd640 1 -- 172.21.15.103:0/2330300085 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc007260 con 0x7f78d40c5950 2024-09-19T05:40:23.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.327+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d40ca8c0 con 0x7f78d40c5950 2024-09-19T05:40:23.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.328+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d40cb540 con 0x7f78d40c5950 2024-09-19T05:40:23.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.329+0000 7f78caffd640 1 -- 172.21.15.103:0/2330300085 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f78bc007400 con 0x7f78d40c5950 2024-09-19T05:40:23.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.329+0000 7f78caffd640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78b406c2b0 0x7f78b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.329+0000 7f78caffd640 1 -- 172.21.15.103:0/2330300085 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f78bc08ac10 con 0x7f78d40c5950 2024-09-19T05:40:23.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.329+0000 7f78d259c640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78b406c2b0 0x7f78b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.330+0000 7f78d259c640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78b406c2b0 0x7f78b406e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f78c4034000 tx=0x7f78c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.334+0000 7f78caffd640 1 -- 172.21.15.103:0/2330300085 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f78bc0589c0 con 0x7f78d40c5950 2024-09-19T05:40:23.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.533+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78d4069380 con 0x7f78d40c5950 2024-09-19T05:40:23.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.533+0000 7f78caffd640 1 -- 172.21.15.103:0/2330300085 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6965 (secure 0 0 0) 0x7f78bc05ccc0 con 0x7f78d40c5950 2024-09-19T05:40:23.536 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:40:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":18,"btime":"2024-09-19T05:38:28:967859+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:28.967854+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4241,4276,4302,4296,4299]},"id":1}]} 2024-09-19T05:40:23.536 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 18 2024-09-19T05:40:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78b406c2b0 msgr2=0x7f78b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78b406c2b0 0x7f78b406e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f78c4034000 tx=0x7f78c402e000 comp rx=0 tx=0).stop 2024-09-19T05:40:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d40c5950 msgr2=0x7f78d41f4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d40c5950 0x7f78d41f4dd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c400 tx=0x7f78bc00c8c0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 shutdown_connections 2024-09-19T05:40:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78b406c2b0 0x7f78b406e770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78d4155040 0x7f78d41f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78d40c5950 0x7f78d41f4dd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 --2- 172.21.15.103:0/2330300085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d40b3540 0x7f78d40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 >> 172.21.15.103:0/2330300085 conn(0x7f78d4073340 msgr2=0x7f78d406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.535+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 shutdown_connections 2024-09-19T05:40:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.536+0000 7f78d8d2a640 1 -- 172.21.15.103:0/2330300085 wait complete. 2024-09-19T05:40:23.550 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T05:40:23.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T05:40:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.646+0000 7fa78dfd8640 1 Processor -- start 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.646+0000 7fa78dfd8640 1 -- start start 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa78dfd8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7880ced60 0x7fa7880c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa78dfd8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78815c120 con 0x7fa788159390 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa78dfd8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa788158bb0 con 0x7fa7880ce980 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa78dfd8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa788071470 con 0x7fa7880ced60 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa787fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa788159390 0x7fa788152a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46452/0 (socket says 172.21.15.103:46452) 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa787fff640 1 -- 172.21.15.103:0/678974428 learned_addr learned my addr 172.21.15.103:0/678974428 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa786ffd640 1 --2- 172.21.15.103:0/678974428 >> v2:172.21.15.103:3300/0 conn(0x7fa7880ced60 0x7fa7880c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa7867fc640 1 -- 172.21.15.103:0/678974428 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216864552 0 0) 0x7fa78815c120 con 0x7fa788159390 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa7867fc640 1 -- 172.21.15.103:0/678974428 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa770003520 con 0x7fa788159390 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa786ffd640 1 -- 172.21.15.103:0/678974428 >> v1:172.21.15.174:6789/0 conn(0x7fa7880ce980 legacy=0x7fa7880c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa786ffd640 1 -- 172.21.15.103:0/678974428 >> v1:172.21.15.103:6789/0 conn(0x7fa788159390 legacy=0x7fa788152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.647+0000 7fa786ffd640 1 -- 172.21.15.103:0/678974428 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa788071750 con 0x7fa7880ced60 2024-09-19T05:40:23.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.648+0000 7fa786ffd640 1 --2- 172.21.15.103:0/678974428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7880c55c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15d4a7c0217bef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:23.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.648+0000 7fa7867fc640 1 -- 172.21.15.103:0/678974428 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c007740 con 0x7fa7880ced60 2024-09-19T05:40:23.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.648+0000 7fa7867fc640 1 -- 172.21.15.103:0/678974428 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c0078e0 con 0x7fa7880ced60 2024-09-19T05:40:23.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.648+0000 7fa7867fc640 1 -- 172.21.15.103:0/678974428 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c007cb0 con 0x7fa7880ced60 2024-09-19T05:40:23.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.649+0000 7fa78dfd8640 1 -- 172.21.15.103:0/678974428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 msgr2=0x7fa7880c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.649+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/678974428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7880c55c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c02a6f0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.649+0000 7fa78dfd8640 1 -- 172.21.15.103:0/678974428 shutdown_connections 2024-09-19T05:40:23.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.649+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/678974428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7880c55c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.649+0000 7fa78dfd8640 1 -- 172.21.15.103:0/678974428 >> 172.21.15.103:0/678974428 conn(0x7fa78806bdf0 msgr2=0x7fa7880734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.649+0000 7fa78dfd8640 1 -- 172.21.15.103:0/678974428 shutdown_connections 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.649+0000 7fa78dfd8640 1 -- 172.21.15.103:0/678974428 wait complete. 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.650+0000 7fa78dfd8640 1 Processor -- start 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.650+0000 7fa78dfd8640 1 -- start start 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa78dfd8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7880ce980 0x7fa7880ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa78dfd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7881f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa78dfd8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa788159390 0x7fa7880cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa78dfd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa788158e70 con 0x7fa7880ced60 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa78dfd8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa788071d10 con 0x7fa788159390 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa78dfd8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa788070d30 con 0x7fa7880ce980 2024-09-19T05:40:23.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7881f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7881f1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39684/0 (socket says 172.21.15.103:39684) 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 -- 172.21.15.103:0/3501859694 learned_addr learned my addr 172.21.15.103:0/3501859694 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa7877fe640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7880ce980 0x7fa7880ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa787fff640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa788159390 0x7fa7880cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 -- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7880ce980 msgr2=0x7fa7880ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7880ce980 0x7fa7880ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 -- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa788159390 msgr2=0x7fa7880cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa788159390 0x7fa7880cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 -- 172.21.15.103:0/3501859694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7881f26c0 con 0x7fa7880ced60 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa786ffd640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7881f1d20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.651+0000 7fa76ffff640 1 -- 172.21.15.103:0/3501859694 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c040070 con 0x7fa7880ced60 2024-09-19T05:40:23.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.652+0000 7fa76ffff640 1 -- 172.21.15.103:0/3501859694 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c031c40 con 0x7fa7880ced60 2024-09-19T05:40:23.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.652+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78815b8f0 con 0x7fa7880ced60 2024-09-19T05:40:23.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.652+0000 7fa76ffff640 1 -- 172.21.15.103:0/3501859694 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c009450 con 0x7fa7880ced60 2024-09-19T05:40:23.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.652+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa788157980 con 0x7fa7880ced60 2024-09-19T05:40:23.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.653+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa788159820 con 0x7fa7880ced60 2024-09-19T05:40:23.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.653+0000 7fa76ffff640 1 -- 172.21.15.103:0/3501859694 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa77c039040 con 0x7fa7880ced60 2024-09-19T05:40:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.653+0000 7fa76ffff640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa77406c2b0 0x7fa77406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.653+0000 7fa76ffff640 1 -- 172.21.15.103:0/3501859694 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa77c0acd80 con 0x7fa7880ced60 2024-09-19T05:40:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.654+0000 7fa7877fe640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa77406c2b0 0x7fa77406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.654+0000 7fa7877fe640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa77406c2b0 0x7fa77406e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa778007fd0 tx=0x7fa778009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.658+0000 7fa76ffff640 1 -- 172.21.15.103:0/3501859694 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa77c07aa10 con 0x7fa7880ced60 2024-09-19T05:40:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.889+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa78814c9e0 con 0x7fa7880ced60 2024-09-19T05:40:23.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.889+0000 7fa76ffff640 1 -- 172.21.15.103:0/3501859694 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fa77c07ed10 con 0x7fa7880ced60 2024-09-19T05:40:23.892 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","modified":"2024-09-19T05:36:43.871228Z","created":"2024-09-19T05:36:43.871228Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa77406c2b0 msgr2=0x7fa77406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa77406c2b0 0x7fa77406e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa778007fd0 tx=0x7fa778009040 comp rx=0 tx=0).stop 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 msgr2=0x7fa7881f1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7881f1d20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c004a40 comp rx=0 tx=0).stop 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 shutdown_connections 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa77406c2b0 0x7fa77406e770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa788159390 0x7fa7880cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7880ced60 0x7fa7881f1d20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 --2- 172.21.15.103:0/3501859694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7880ce980 0x7fa7880ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 >> 172.21.15.103:0/3501859694 conn(0x7fa78806bdf0 msgr2=0x7fa788067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 shutdown_connections 2024-09-19T05:40:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:23.891+0000 7fa78dfd8640 1 -- 172.21.15.103:0/3501859694 wait complete. 2024-09-19T05:40:23.905 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T05:40:23.905 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T05:40:23.914 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T05:40:23.914 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:40:23.914 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:40:23.930 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:40:23.930 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:40:23.987 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:40:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.124+0000 7fdb4d45e640 1 Processor -- start 2024-09-19T05:40:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.124+0000 7fdb4d45e640 1 -- start start 2024-09-19T05:40:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.125+0000 7fdb4d45e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 0x7fdb480cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.125+0000 7fdb4d45e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb480cbed0 con 0x7fdb48155040 2024-09-19T05:40:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.125+0000 7fdb4d45e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4815bd70 con 0x7fdb480c5950 2024-09-19T05:40:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.125+0000 7fdb4d45e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdb480cbbf0 con 0x7fdb480b3540 2024-09-19T05:40:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.125+0000 7fdb46ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdb48155040 0x7fdb4815e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46454/0 (socket says 172.21.15.103:46454) 2024-09-19T05:40:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.125+0000 7fdb46ffd640 1 -- 172.21.15.103:0/3919453958 learned_addr learned my addr 172.21.15.103:0/3919453958 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb467fc640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 0x7fdb480cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603775915 0 0) 0x7fdb480cbed0 con 0x7fdb48155040 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb34003520 con 0x7fdb48155040 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1133478831 0 0) 0x7fdb34003520 con 0x7fdb48155040 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 msgr2=0x7fdb480cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 0x7fdb480cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 >> v1:172.21.15.174:6789/0 conn(0x7fdb480c5950 legacy=0x7fdb480cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4815afb0 con 0x7fdb48155040 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fdb400019f0 con 0x7fdb48155040 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 >> v1:172.21.15.103:6789/0 conn(0x7fdb48155040 legacy=0x7fdb4815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb340039e0 0x7fdb34003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 0x7fdb34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb34004d40 0x7fdb340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb480cbbf0 con 0x7fdb34004d40 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3400bb30 con 0x7fdb340039e0 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3400bd30 con 0x7fdb480b3540 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb477fe640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb34004d40 0x7fdb340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb46ffd640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb340039e0 0x7fdb34003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb467fc640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 0x7fdb34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb477fe640 1 -- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 msgr2=0x7fdb34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb477fe640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb480b3540 0x7fdb34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb477fe640 1 -- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb340039e0 msgr2=0x7fdb34003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb477fe640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb340039e0 0x7fdb34003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.126+0000 7fdb477fe640 1 -- 172.21.15.103:0/3919453958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb34003520 con 0x7fdb34004d40 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.127+0000 7fdb477fe640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb34004d40 0x7fdb340051c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdb38001720 tx=0x7fdb34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73a7cb0e4ba6de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.127+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38001370 con 0x7fdb34004d40 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.127+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb380052d0 con 0x7fdb34004d40 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.127+0000 7fdb45ffb640 1 -- 172.21.15.103:0/3919453958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3802abc0 con 0x7fdb34004d40 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.128+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3919453958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb34004d40 msgr2=0x7fdb340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.128+0000 7fdb4d45e640 1 --2- 172.21.15.103:0/3919453958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb34004d40 0x7fdb340051c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdb38001720 tx=0x7fdb34005830 comp rx=0 tx=0).stop 2024-09-19T05:40:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.128+0000 7fdb477fe640 1 -- 172.21.15.103:0/3919453958 reap_dead start 2024-09-19T05:40:24.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.128+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3919453958 shutdown_connections 2024-09-19T05:40:24.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.128+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3919453958 >> 172.21.15.103:0/3919453958 conn(0x7fdb48073340 msgr2=0x7fdb48073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:24.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.128+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3919453958 shutdown_connections 2024-09-19T05:40:24.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.128+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3919453958 wait complete. 2024-09-19T05:40:24.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.129+0000 7fdb4d45e640 1 Processor -- start 2024-09-19T05:40:24.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.129+0000 7fdb4d45e640 1 -- start start 2024-09-19T05:40:24.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb4d45e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb34004d40 0x7fdb481e6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb4d45e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb4815ce10 0x7fdb4815d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb4d45e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4814b0e0 0x7fdb4814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb4d45e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4815b850 con 0x7fdb4814b0e0 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb4d45e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4815b570 con 0x7fdb34004d40 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb4d45e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4815eb30 con 0x7fdb4815ce10 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4814b0e0 0x7fdb4814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4814b0e0 0x7fdb4814b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39692/0 (socket says 172.21.15.103:39692) 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 -- 172.21.15.103:0/3117136279 learned_addr learned my addr 172.21.15.103:0/3117136279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb46ffd640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb34004d40 0x7fdb481e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb467fc640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb4815ce10 0x7fdb4815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 -- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb4815ce10 msgr2=0x7fdb4815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb4815ce10 0x7fdb4815d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 -- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb34004d40 msgr2=0x7fdb481e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb34004d40 0x7fdb481e6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.130+0000 7fdb477fe640 1 -- 172.21.15.103:0/3117136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4815c090 con 0x7fdb4814b0e0 2024-09-19T05:40:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.131+0000 7fdb477fe640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4814b0e0 0x7fdb4814b560 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdb3802a570 tx=0x7fdb38001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.131+0000 7fdb3f7fe640 1 -- 172.21.15.103:0/3117136279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38037040 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.131+0000 7fdb3f7fe640 1 -- 172.21.15.103:0/3117136279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb38040070 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.131+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb481f1910 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.131+0000 7fdb3f7fe640 1 -- 172.21.15.103:0/3117136279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38001370 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.131+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4815c610 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.132+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb480cb540 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.132+0000 7fdb3f7fe640 1 -- 172.21.15.103:0/3117136279 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdb380052d0 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.133+0000 7fdb3f7fe640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb2806c2b0 0x7fdb2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.133+0000 7fdb3f7fe640 1 -- 172.21.15.103:0/3117136279 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdb380aaf10 con 0x7fdb4814b0e0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.133+0000 7fdb46ffd640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb2806c2b0 0x7fdb2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.133+0000 7fdb46ffd640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb2806c2b0 0x7fdb2806e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdb400013d0 tx=0x7fdb40006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:24.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.137+0000 7fdb3f7fe640 1 -- 172.21.15.103:0/3117136279 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdb38079310 con 0x7fdb4814b0e0 2024-09-19T05:40:24.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.315+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdb48069380 con 0x7fdb4814b0e0 2024-09-19T05:40:24.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.316+0000 7fdb3f7fe640 1 -- 172.21.15.103:0/3117136279 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fdb38078c10 con 0x7fdb4814b0e0 2024-09-19T05:40:24.318 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-19T05:40:24.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb2806c2b0 msgr2=0x7fdb2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb2806c2b0 0x7fdb2806e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdb400013d0 tx=0x7fdb40006040 comp rx=0 tx=0).stop 2024-09-19T05:40:24.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4814b0e0 msgr2=0x7fdb4814b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4814b0e0 0x7fdb4814b560 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdb3802a570 tx=0x7fdb38001120 comp rx=0 tx=0).stop 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 shutdown_connections 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdb2806c2b0 0x7fdb2806e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4814b0e0 0x7fdb4814b560 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb4815ce10 0x7fdb4815d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 --2- 172.21.15.103:0/3117136279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb34004d40 0x7fdb481e6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 >> 172.21.15.103:0/3117136279 conn(0x7fdb48073340 msgr2=0x7fdb4814e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 shutdown_connections 2024-09-19T05:40:24.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.318+0000 7fdb4d45e640 1 -- 172.21.15.103:0/3117136279 wait complete. 2024-09-19T05:40:24.331 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-19T05:40:24.331 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:40:24.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T05:40:24.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.484+0000 7fbaeab9f640 1 Processor -- start 2024-09-19T05:40:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.484+0000 7fbaeab9f640 1 -- start start 2024-09-19T05:40:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbaeab9f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbae4153100 0x7fbae40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbaeab9f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbae4074480 0x7fbae40c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbaeab9f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae415c330 con 0x7fbae4152d20 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbaeab9f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbae415d190 con 0x7fbae4074480 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbaeab9f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbae415c610 con 0x7fbae4153100 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae913c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbae4074480 0x7fbae40c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae893b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbae4152d20 0x7fbae406c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46470/0 (socket says 172.21.15.103:46470) 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae893b640 1 -- 172.21.15.103:0/825479437 learned_addr learned my addr 172.21.15.103:0/825479437 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae913c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbae4074480 0x7fbae40c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39694/0 (socket says 172.21.15.103:39694) 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbadbfff640 1 --2- 172.21.15.103:0/825479437 >> v2:172.21.15.174:3300/0 conn(0x7fbae4153100 0x7fbae40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae913c640 1 -- 172.21.15.103:0/825479437 >> v2:172.21.15.174:3300/0 conn(0x7fbae4153100 msgr2=0x7fbae40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae913c640 1 --2- 172.21.15.103:0/825479437 >> v2:172.21.15.174:3300/0 conn(0x7fbae4153100 0x7fbae40c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae913c640 1 -- 172.21.15.103:0/825479437 >> v1:172.21.15.103:6789/0 conn(0x7fbae4152d20 legacy=0x7fbae406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbae913c640 1 -- 172.21.15.103:0/825479437 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae415c8f0 con 0x7fbae4074480 2024-09-19T05:40:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.485+0000 7fbadb7fe640 1 -- 172.21.15.103:0/825479437 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424850298 0 0) 0x7fbae415c330 con 0x7fbae4152d20 2024-09-19T05:40:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.486+0000 7fbae913c640 1 --2- 172.21.15.103:0/825479437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4074480 0x7fbae40c61a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbae40c3790 tx=0x7fbadc02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc12e15546da912 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.486+0000 7fbadb7fe640 1 -- 172.21.15.103:0/825479437 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc007740 con 0x7fbae4074480 2024-09-19T05:40:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.486+0000 7fbadb7fe640 1 -- 172.21.15.103:0/825479437 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbadc0078e0 con 0x7fbae4074480 2024-09-19T05:40:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.486+0000 7fbadb7fe640 1 -- 172.21.15.103:0/825479437 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc007cb0 con 0x7fbae4074480 2024-09-19T05:40:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.486+0000 7fbaeab9f640 1 -- 172.21.15.103:0/825479437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4074480 msgr2=0x7fbae40c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.486+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/825479437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4074480 0x7fbae40c61a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbae40c3790 tx=0x7fbadc02a560 comp rx=0 tx=0).stop 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.487+0000 7fbaeab9f640 1 -- 172.21.15.103:0/825479437 shutdown_connections 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.487+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/825479437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4074480 0x7fbae40c61a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.487+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/825479437 >> v2:172.21.15.174:3300/0 conn(0x7fbae4153100 0x7fbae40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.487+0000 7fbaeab9f640 1 -- 172.21.15.103:0/825479437 >> 172.21.15.103:0/825479437 conn(0x7fbae40c9230 msgr2=0x7fbae40c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.487+0000 7fbaeab9f640 1 -- 172.21.15.103:0/825479437 shutdown_connections 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.487+0000 7fbaeab9f640 1 -- 172.21.15.103:0/825479437 wait complete. 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.488+0000 7fbaeab9f640 1 Processor -- start 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.488+0000 7fbaeab9f640 1 -- start start 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbae4074480 0x7fbae414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4152d20 0x7fbae41ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4153100 0x7fbae4158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbae406cfe0 con 0x7fbae4153100 2024-09-19T05:40:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbae415ceb0 con 0x7fbae4152d20 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbae406d160 con 0x7fbae4074480 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4153100 0x7fbae4158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4153100 0x7fbae4158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39700/0 (socket says 172.21.15.103:39700) 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 -- 172.21.15.103:0/2537752353 learned_addr learned my addr 172.21.15.103:0/2537752353 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 -- 172.21.15.103:0/2537752353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbae4074480 msgr2=0x7fbae414e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbae4074480 0x7fbae414e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 -- 172.21.15.103:0/2537752353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4152d20 msgr2=0x7fbae41ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4152d20 0x7fbae41ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 -- 172.21.15.103:0/2537752353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae41e2710 con 0x7fbae4153100 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbae913c640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4153100 0x7fbae4158610 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009e50 tx=0x7fbadc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbad97fa640 1 -- 172.21.15.103:0/2537752353 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc03f070 con 0x7fbae4153100 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbad97fa640 1 -- 172.21.15.103:0/2537752353 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbadc031cc0 con 0x7fbae4153100 2024-09-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae41e2170 con 0x7fbae4153100 2024-09-19T05:40:24.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbad97fa640 1 -- 172.21.15.103:0/2537752353 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc044680 con 0x7fbae4153100 2024-09-19T05:40:24.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.489+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae414d990 con 0x7fbae4153100 2024-09-19T05:40:24.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.490+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae406c8d0 con 0x7fbae4153100 2024-09-19T05:40:24.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.491+0000 7fbad97fa640 1 -- 172.21.15.103:0/2537752353 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbadc03b410 con 0x7fbae4153100 2024-09-19T05:40:24.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.491+0000 7fbad97fa640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbad006c2b0 0x7fbad006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:24.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.491+0000 7fbae893b640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbad006c2b0 0x7fbad006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:24.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.491+0000 7fbad97fa640 1 -- 172.21.15.103:0/2537752353 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbadc0ad1f0 con 0x7fbae4153100 2024-09-19T05:40:24.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.492+0000 7fbae893b640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbad006c2b0 0x7fbad006e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbae0007fd0 tx=0x7fbae0007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:24.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.495+0000 7fbad97fa640 1 -- 172.21.15.103:0/2537752353 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbadc07b590 con 0x7fbae4153100 2024-09-19T05:40:24.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.671+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbae40cafe0 con 0x7fbae4153100 2024-09-19T05:40:24.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.671+0000 7fbad97fa640 1 -- 172.21.15.103:0/2537752353 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fbadc07ae90 con 0x7fbae4153100 2024-09-19T05:40:24.674 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-19T05:40:24.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbad006c2b0 msgr2=0x7fbad006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbad006c2b0 0x7fbad006e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbae0007fd0 tx=0x7fbae0007960 comp rx=0 tx=0).stop 2024-09-19T05:40:24.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4153100 msgr2=0x7fbae4158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:24.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4153100 0x7fbae4158610 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009e50 tx=0x7fbadc004a40 comp rx=0 tx=0).stop 2024-09-19T05:40:24.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 shutdown_connections 2024-09-19T05:40:24.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fbad006c2b0 0x7fbad006e770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbae4153100 0x7fbae4158610 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4152d20 0x7fbae41ef940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 --2- 172.21.15.103:0/2537752353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbae4074480 0x7fbae414e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:24.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 >> 172.21.15.103:0/2537752353 conn(0x7fbae40c9230 msgr2=0x7fbae4158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:24.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 shutdown_connections 2024-09-19T05:40:24.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:24.673+0000 7fbaeab9f640 1 -- 172.21.15.103:0/2537752353 wait complete. 2024-09-19T05:40:24.687 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-19T05:40:24.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:24.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:40:24.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[45335]: fuse finished with error 0 and tester_r 0 2024-09-19T05:40:24.712 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:40:30.813 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:40:30.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:30.814 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:40:30.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:30.834 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-19T05:40:30.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:40:30.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:30.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:40:30.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:40:30.963 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-19T05:40:31.064 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T05:40:31.074 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T05:40:31.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:31.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.176+0000 7ff49b3fd640 1 Processor -- start 2024-09-19T05:40:31.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.176+0000 7ff49b3fd640 1 -- start start 2024-09-19T05:40:31.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff49b3fd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff494151ea0 0x7ff4940c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff49b3fd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff4940c46c0 0x7ff494158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff49b3fd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49415bc80 con 0x7ff494159510 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff49b3fd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff4941585a0 con 0x7ff494151ea0 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff49b3fd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff494157c70 con 0x7ff4940c46c0 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff499199640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff494151ea0 0x7ff4940c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff499199640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff494151ea0 0x7ff4940c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39704/0 (socket says 172.21.15.103:39704) 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.177+0000 7ff499199640 1 -- 172.21.15.103:0/1390313945 learned_addr learned my addr 172.21.15.103:0/1390313945 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.178+0000 7ff498998640 1 --2- 172.21.15.103:0/1390313945 >> v2:172.21.15.174:3300/0 conn(0x7ff4940c46c0 0x7ff494158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.178+0000 7ff499199640 1 -- 172.21.15.103:0/1390313945 >> v2:172.21.15.174:3300/0 conn(0x7ff4940c46c0 msgr2=0x7ff494158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.178+0000 7ff499199640 1 --2- 172.21.15.103:0/1390313945 >> v2:172.21.15.174:3300/0 conn(0x7ff4940c46c0 0x7ff494158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.178+0000 7ff499199640 1 -- 172.21.15.103:0/1390313945 >> v1:172.21.15.103:6789/0 conn(0x7ff494159510 legacy=0x7ff49406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.178+0000 7ff499199640 1 -- 172.21.15.103:0/1390313945 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff494157f50 con 0x7ff494151ea0 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.178+0000 7ff499199640 1 --2- 172.21.15.103:0/1390313945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494151ea0 0x7ff4940c89b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff494158720 tx=0x7ff48c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c865f7181c9f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff493fff640 1 -- 172.21.15.103:0/1390313945 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c037070 con 0x7ff494151ea0 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff493fff640 1 -- 172.21.15.103:0/1390313945 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c02ae50 con 0x7ff494151ea0 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff493fff640 1 -- 172.21.15.103:0/1390313945 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c032860 con 0x7ff494151ea0 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 -- 172.21.15.103:0/1390313945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494151ea0 msgr2=0x7ff4940c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/1390313945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494151ea0 0x7ff4940c89b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff494158720 tx=0x7ff48c02a300 comp rx=0 tx=0).stop 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 -- 172.21.15.103:0/1390313945 shutdown_connections 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/1390313945 >> v2:172.21.15.174:3300/0 conn(0x7ff4940c46c0 0x7ff494158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/1390313945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494151ea0 0x7ff4940c89b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 -- 172.21.15.103:0/1390313945 >> 172.21.15.103:0/1390313945 conn(0x7ff4940c9230 msgr2=0x7ff4940c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 -- 172.21.15.103:0/1390313945 shutdown_connections 2024-09-19T05:40:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.179+0000 7ff49b3fd640 1 -- 172.21.15.103:0/1390313945 wait complete. 2024-09-19T05:40:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.180+0000 7ff49b3fd640 1 Processor -- start 2024-09-19T05:40:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.180+0000 7ff49b3fd640 1 -- start start 2024-09-19T05:40:31.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49b3fd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4940c46c0 0x7ff4941ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49b3fd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff494151ea0 0x7ff49415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49b3fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494159510 0x7ff49415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49b3fd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff494158a30 con 0x7ff494159510 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49b3fd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff494152280 con 0x7ff494151ea0 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49b3fd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff49415bf20 con 0x7ff4940c46c0 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494159510 0x7ff49415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494159510 0x7ff49415b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39716/0 (socket says 172.21.15.103:39716) 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 -- 172.21.15.103:0/2211678112 learned_addr learned my addr 172.21.15.103:0/2211678112 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff499199640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4940c46c0 0x7ff4941ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 -- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4940c46c0 msgr2=0x7ff4941ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4940c46c0 0x7ff4941ef400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff498998640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff494151ea0 0x7ff49415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 -- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff494151ea0 msgr2=0x7ff49415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff494151ea0 0x7ff49415a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.181+0000 7ff49999a640 1 -- 172.21.15.103:0/2211678112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49415b7a0 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.182+0000 7ff49999a640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494159510 0x7ff49415b260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c760 tx=0x7ff48400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.182+0000 7ff491ffb640 1 -- 172.21.15.103:0/2211678112 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484003b70 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.182+0000 7ff491ffb640 1 -- 172.21.15.103:0/2211678112 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff484003d10 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.182+0000 7ff491ffb640 1 -- 172.21.15.103:0/2211678112 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48400aa90 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.182+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49414bca0 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.182+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49415af80 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.183+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4940c3a50 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.183+0000 7ff491ffb640 1 -- 172.21.15.103:0/2211678112 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff48400ac30 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.184+0000 7ff491ffb640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff48006c2b0 0x7ff48006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.184+0000 7ff491ffb640 1 -- 172.21.15.103:0/2211678112 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff48408b740 con 0x7ff494159510 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.184+0000 7ff499199640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff48006c2b0 0x7ff48006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.184+0000 7ff499199640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff48006c2b0 0x7ff48006e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff48c034000 tx=0x7ff48c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.188+0000 7ff491ffb640 1 -- 172.21.15.103:0/2211678112 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff484059a10 con 0x7ff494159510 2024-09-19T05:40:31.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.353+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff49414f270 con 0x7ff48006c2b0 2024-09-19T05:40:31.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.361+0000 7ff491ffb640 1 -- 172.21.15.103:0/2211678112 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332906 (secure 0 0 0) 0x7ff49414f270 con 0x7ff48006c2b0 2024-09-19T05:40:31.367 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:40:31.369 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:40:31.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff48006c2b0 msgr2=0x7ff48006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff48006c2b0 0x7ff48006e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff48c034000 tx=0x7ff48c02e000 comp rx=0 tx=0).stop 2024-09-19T05:40:31.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494159510 msgr2=0x7ff49415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494159510 0x7ff49415b260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c760 tx=0x7ff48400cc20 comp rx=0 tx=0).stop 2024-09-19T05:40:31.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 shutdown_connections 2024-09-19T05:40:31.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7ff48006c2b0 0x7ff48006e770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff494159510 0x7ff49415b260 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff494151ea0 0x7ff49415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 --2- 172.21.15.103:0/2211678112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4940c46c0 0x7ff4941ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 >> 172.21.15.103:0/2211678112 conn(0x7ff4940c9230 msgr2=0x7ff494156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:31.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 shutdown_connections 2024-09-19T05:40:31.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.365+0000 7ff49b3fd640 1 -- 172.21.15.103:0/2211678112 wait complete. 2024-09-19T05:40:31.378 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-19T05:40:30.219778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639662,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":425,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2867200,"data_stored":2284388,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003633"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955735+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:38:28.955735+0000","last_peered":"2024-09-19T05:38:28.955735+0000","last_clean":"2024-09-19T05:38:28.955735+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:38:28.955735+0000","last_undegraded":"2024-09-19T05:38:28.955735+0000","last_fullsized":"2024-09-19T05:38:28.955735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744889+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:40:24.744889+0000","last_peered":"2024-09-19T05:40:24.744889+0000","last_clean":"2024-09-19T05:40:24.744889+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:40:24.744889+0000","last_undegraded":"2024-09-19T05:40:24.744889+0000","last_fullsized":"2024-09-19T05:40:24.744889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965402+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:38:25.965402+0000","last_peered":"2024-09-19T05:38:25.965402+0000","last_clean":"2024-09-19T05:38:25.965402+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:38:25.965402+0000","last_undegraded":"2024-09-19T05:38:25.965402+0000","last_fullsized":"2024-09-19T05:38:25.965402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966602+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:38:25.966602+0000","last_peered":"2024-09-19T05:38:25.966602+0000","last_clean":"2024-09-19T05:38:25.966602+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:38:25.966602+0000","last_undegraded":"2024-09-19T05:38:25.966602+0000","last_fullsized":"2024-09-19T05:38:25.966602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758565+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:40:24.758565+0000","last_peered":"2024-09-19T05:40:24.758565+0000","last_clean":"2024-09-19T05:40:24.758565+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:40:24.758565+0000","last_undegraded":"2024-09-19T05:40:24.758565+0000","last_fullsized":"2024-09-19T05:40:24.758565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963867+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:38:25.963867+0000","last_peered":"2024-09-19T05:38:25.963867+0000","last_clean":"2024-09-19T05:38:25.963867+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:38:25.963867+0000","last_undegraded":"2024-09-19T05:38:25.963867+0000","last_fullsized":"2024-09-19T05:38:25.963867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878401+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:39:40.878401+0000","last_peered":"2024-09-19T05:39:40.878401+0000","last_clean":"2024-09-19T05:39:40.878401+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:39:40.878401+0000","last_undegraded":"2024-09-19T05:39:40.878401+0000","last_fullsized":"2024-09-19T05:39:40.878401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758867+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:40:24.758867+0000","last_peered":"2024-09-19T05:40:24.758867+0000","last_clean":"2024-09-19T05:40:24.758867+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:40:24.758867+0000","last_undegraded":"2024-09-19T05:40:24.758867+0000","last_fullsized":"2024-09-19T05:40:24.758867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964212+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:38:25.964212+0000","last_peered":"2024-09-19T05:38:25.964212+0000","last_clean":"2024-09-19T05:38:25.964212+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:38:25.964212+0000","last_undegraded":"2024-09-19T05:38:25.964212+0000","last_fullsized":"2024-09-19T05:38:25.964212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.956064+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:38:28.956064+0000","last_peered":"2024-09-19T05:38:28.956064+0000","last_clean":"2024-09-19T05:38:28.956064+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:38:28.956064+0000","last_undegraded":"2024-09-19T05:38:28.956064+0000","last_fullsized":"2024-09-19T05:38:28.956064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758625+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:40:24.758625+0000","last_peered":"2024-09-19T05:40:24.758625+0000","last_clean":"2024-09-19T05:40:24.758625+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:40:24.758625+0000","last_undegraded":"2024-09-19T05:40:24.758625+0000","last_fullsized":"2024-09-19T05:40:24.758625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963776+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:38:25.963776+0000","last_peered":"2024-09-19T05:38:25.963776+0000","last_clean":"2024-09-19T05:38:25.963776+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:38:25.963776+0000","last_undegraded":"2024-09-19T05:38:25.963776+0000","last_fullsized":"2024-09-19T05:38:25.963776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751142+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:40:24.751142+0000","last_peered":"2024-09-19T05:40:24.751142+0000","last_clean":"2024-09-19T05:40:24.751142+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:40:24.751142+0000","last_undegraded":"2024-09-19T05:40:24.751142+0000","last_fullsized":"2024-09-19T05:40:24.751142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878423+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:39:40.878423+0000","last_peered":"2024-09-19T05:39:40.878423+0000","last_clean":"2024-09-19T05:39:40.878423+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:39:40.878423+0000","last_undegraded":"2024-09-19T05:39:40.878423+0000","last_fullsized":"2024-09-19T05:39:40.878423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964596+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:38:25.964596+0000","last_peered":"2024-09-19T05:38:25.964596+0000","last_clean":"2024-09-19T05:38:25.964596+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:38:25.964596+0000","last_undegraded":"2024-09-19T05:38:25.964596+0000","last_fullsized":"2024-09-19T05:38:25.964596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750298+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:40:24.750298+0000","last_peered":"2024-09-19T05:40:24.750298+0000","last_clean":"2024-09-19T05:40:24.750298+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:40:24.750298+0000","last_undegraded":"2024-09-19T05:40:24.750298+0000","last_fullsized":"2024-09-19T05:40:24.750298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:43.953488+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:39:43.953488+0000","last_peered":"2024-09-19T05:39:43.953488+0000","last_clean":"2024-09-19T05:39:43.953488+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:39:43.953488+0000","last_undegraded":"2024-09-19T05:39:43.953488+0000","last_fullsized":"2024-09-19T05:39:43.953488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964548+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:38:25.964548+0000","last_peered":"2024-09-19T05:38:25.964548+0000","last_clean":"2024-09-19T05:38:25.964548+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:38:25.964548+0000","last_undegraded":"2024-09-19T05:38:25.964548+0000","last_fullsized":"2024-09-19T05:38:25.964548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750263+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:40:24.750263+0000","last_peered":"2024-09-19T05:40:24.750263+0000","last_clean":"2024-09-19T05:40:24.750263+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:40:24.750263+0000","last_undegraded":"2024-09-19T05:40:24.750263+0000","last_fullsized":"2024-09-19T05:40:24.750263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955690+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:38:28.955690+0000","last_peered":"2024-09-19T05:38:28.955690+0000","last_clean":"2024-09-19T05:38:28.955690+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:38:28.955690+0000","last_undegraded":"2024-09-19T05:38:28.955690+0000","last_fullsized":"2024-09-19T05:38:28.955690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963574+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:38:25.963574+0000","last_peered":"2024-09-19T05:38:25.963574+0000","last_clean":"2024-09-19T05:38:25.963574+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:38:25.963574+0000","last_undegraded":"2024-09-19T05:38:25.963574+0000","last_fullsized":"2024-09-19T05:38:25.963574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.720132+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:40:24.720132+0000","last_peered":"2024-09-19T05:40:24.720132+0000","last_clean":"2024-09-19T05:40:24.720132+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:40:24.720132+0000","last_undegraded":"2024-09-19T05:40:24.720132+0000","last_fullsized":"2024-09-19T05:40:24.720132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668599+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:26.668599+0000","last_peered":"2024-09-19T05:38:26.668599+0000","last_clean":"2024-09-19T05:38:26.668599+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:26.668599+0000","last_undegraded":"2024-09-19T05:38:26.668599+0000","last_fullsized":"2024-09-19T05:38:26.668599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964806+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:38:25.964806+0000","last_peered":"2024-09-19T05:38:25.964806+0000","last_clean":"2024-09-19T05:38:25.964806+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:38:25.964806+0000","last_undegraded":"2024-09-19T05:38:25.964806+0000","last_fullsized":"2024-09-19T05:38:25.964806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747015+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:40:24.747015+0000","last_peered":"2024-09-19T05:40:24.747015+0000","last_clean":"2024-09-19T05:40:24.747015+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:40:24.747015+0000","last_undegraded":"2024-09-19T05:40:24.747015+0000","last_fullsized":"2024-09-19T05:40:24.747015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888103+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:39:40.888103+0000","last_peered":"2024-09-19T05:39:40.888103+0000","last_clean":"2024-09-19T05:39:40.888103+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:39:40.888103+0000","last_undegraded":"2024-09-19T05:39:40.888103+0000","last_fullsized":"2024-09-19T05:39:40.888103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964361+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:38:25.964361+0000","last_peered":"2024-09-19T05:38:25.964361+0000","last_clean":"2024-09-19T05:38:25.964361+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:38:25.964361+0000","last_undegraded":"2024-09-19T05:38:25.964361+0000","last_fullsized":"2024-09-19T05:38:25.964361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754785+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:40:24.754785+0000","last_peered":"2024-09-19T05:40:24.754785+0000","last_clean":"2024-09-19T05:40:24.754785+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:40:24.754785+0000","last_undegraded":"2024-09-19T05:40:24.754785+0000","last_fullsized":"2024-09-19T05:40:24.754785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.842259+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:39:45.842259+0000","last_peered":"2024-09-19T05:39:45.842259+0000","last_clean":"2024-09-19T05:39:45.842259+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:39:45.842259+0000","last_undegraded":"2024-09-19T05:39:45.842259+0000","last_fullsized":"2024-09-19T05:39:45.842259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.698091+0000","last_change":"2024-09-19T05:38:26.696320+0000","last_active":"2024-09-19T05:38:26.698091+0000","last_peered":"2024-09-19T05:38:26.698091+0000","last_clean":"2024-09-19T05:38:26.698091+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:38:26.698091+0000","last_undegraded":"2024-09-19T05:38:26.698091+0000","last_fullsized":"2024-09-19T05:38:26.698091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:33.249021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745141+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:40:24.745141+0000","last_peered":"2024-09-19T05:40:24.745141+0000","last_clean":"2024-09-19T05:40:24.745141+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:40:24.745141+0000","last_undegraded":"2024-09-19T05:40:24.745141+0000","last_fullsized":"2024-09-19T05:40:24.745141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954034+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:38:28.954034+0000","last_peered":"2024-09-19T05:38:28.954034+0000","last_clean":"2024-09-19T05:38:28.954034+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:38:28.954034+0000","last_undegraded":"2024-09-19T05:38:28.954034+0000","last_fullsized":"2024-09-19T05:38:28.954034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694996+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:38:26.694996+0000","last_peered":"2024-09-19T05:38:26.694996+0000","last_clean":"2024-09-19T05:38:26.694996+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:38:26.694996+0000","last_undegraded":"2024-09-19T05:38:26.694996+0000","last_fullsized":"2024-09-19T05:38:26.694996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758249+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:40:24.758249+0000","last_peered":"2024-09-19T05:40:24.758249+0000","last_clean":"2024-09-19T05:40:24.758249+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:40:24.758249+0000","last_undegraded":"2024-09-19T05:40:24.758249+0000","last_fullsized":"2024-09-19T05:40:24.758249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963778+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:38:25.963778+0000","last_peered":"2024-09-19T05:38:25.963778+0000","last_clean":"2024-09-19T05:38:25.963778+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:38:25.963778+0000","last_undegraded":"2024-09-19T05:38:25.963778+0000","last_fullsized":"2024-09-19T05:38:25.963778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963227+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:38:25.963227+0000","last_peered":"2024-09-19T05:38:25.963227+0000","last_clean":"2024-09-19T05:38:25.963227+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:38:25.963227+0000","last_undegraded":"2024-09-19T05:38:25.963227+0000","last_fullsized":"2024-09-19T05:38:25.963227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745710+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:40:24.745710+0000","last_peered":"2024-09-19T05:40:24.745710+0000","last_clean":"2024-09-19T05:40:24.745710+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:40:24.745710+0000","last_undegraded":"2024-09-19T05:40:24.745710+0000","last_fullsized":"2024-09-19T05:40:24.745710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958110+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:38:28.958110+0000","last_peered":"2024-09-19T05:38:28.958110+0000","last_clean":"2024-09-19T05:38:28.958110+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:38:28.958110+0000","last_undegraded":"2024-09-19T05:38:28.958110+0000","last_fullsized":"2024-09-19T05:38:28.958110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963683+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:38:25.963683+0000","last_peered":"2024-09-19T05:38:25.963683+0000","last_clean":"2024-09-19T05:38:25.963683+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:38:25.963683+0000","last_undegraded":"2024-09-19T05:38:25.963683+0000","last_fullsized":"2024-09-19T05:38:25.963683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.742108+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:40:24.742108+0000","last_peered":"2024-09-19T05:40:24.742108+0000","last_clean":"2024-09-19T05:40:24.742108+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:40:24.742108+0000","last_undegraded":"2024-09-19T05:40:24.742108+0000","last_fullsized":"2024-09-19T05:40:24.742108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'10","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:50.206587+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:39:50.206587+0000","last_peered":"2024-09-19T05:39:50.206587+0000","last_clean":"2024-09-19T05:39:50.206587+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:39:50.206587+0000","last_undegraded":"2024-09-19T05:39:50.206587+0000","last_fullsized":"2024-09-19T05:39:50.206587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963800+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:38:25.963800+0000","last_peered":"2024-09-19T05:38:25.963800+0000","last_clean":"2024-09-19T05:38:25.963800+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:38:25.963800+0000","last_undegraded":"2024-09-19T05:38:25.963800+0000","last_fullsized":"2024-09-19T05:38:25.963800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745854+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:40:24.745854+0000","last_peered":"2024-09-19T05:40:24.745854+0000","last_clean":"2024-09-19T05:40:24.745854+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:40:24.745854+0000","last_undegraded":"2024-09-19T05:40:24.745854+0000","last_fullsized":"2024-09-19T05:40:24.745854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.953555+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:38:28.953555+0000","last_peered":"2024-09-19T05:38:28.953555+0000","last_clean":"2024-09-19T05:38:28.953555+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:38:28.953555+0000","last_undegraded":"2024-09-19T05:38:28.953555+0000","last_fullsized":"2024-09-19T05:38:28.953555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695310+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:38:26.695310+0000","last_peered":"2024-09-19T05:38:26.695310+0000","last_clean":"2024-09-19T05:38:26.695310+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:38:26.695310+0000","last_undegraded":"2024-09-19T05:38:26.695310+0000","last_fullsized":"2024-09-19T05:38:26.695310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763014+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:40:24.763014+0000","last_peered":"2024-09-19T05:40:24.763014+0000","last_clean":"2024-09-19T05:40:24.763014+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:40:24.763014+0000","last_undegraded":"2024-09-19T05:40:24.763014+0000","last_fullsized":"2024-09-19T05:40:24.763014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954148+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:28.954148+0000","last_peered":"2024-09-19T05:38:28.954148+0000","last_clean":"2024-09-19T05:38:28.954148+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:28.954148+0000","last_undegraded":"2024-09-19T05:38:28.954148+0000","last_fullsized":"2024-09-19T05:38:28.954148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668707+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:38:26.668707+0000","last_peered":"2024-09-19T05:38:26.668707+0000","last_clean":"2024-09-19T05:38:26.668707+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:38:26.668707+0000","last_undegraded":"2024-09-19T05:38:26.668707+0000","last_fullsized":"2024-09-19T05:38:26.668707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963638+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:38:25.963638+0000","last_peered":"2024-09-19T05:38:25.963638+0000","last_clean":"2024-09-19T05:38:25.963638+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:38:25.963638+0000","last_undegraded":"2024-09-19T05:38:25.963638+0000","last_fullsized":"2024-09-19T05:38:25.963638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759101+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:40:24.759101+0000","last_peered":"2024-09-19T05:40:24.759101+0000","last_clean":"2024-09-19T05:40:24.759101+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:40:24.759101+0000","last_undegraded":"2024-09-19T05:40:24.759101+0000","last_fullsized":"2024-09-19T05:40:24.759101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.207954+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:40:00.207954+0000","last_peered":"2024-09-19T05:40:00.207954+0000","last_clean":"2024-09-19T05:40:00.207954+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:40:00.207954+0000","last_undegraded":"2024-09-19T05:40:00.207954+0000","last_fullsized":"2024-09-19T05:40:00.207954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697544+0000","last_change":"2024-09-19T05:38:26.696465+0000","last_active":"2024-09-19T05:38:26.697544+0000","last_peered":"2024-09-19T05:38:26.697544+0000","last_clean":"2024-09-19T05:38:26.697544+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:38:26.697544+0000","last_undegraded":"2024-09-19T05:38:26.697544+0000","last_fullsized":"2024-09-19T05:38:26.697544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:04.587288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757448+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:40:24.757448+0000","last_peered":"2024-09-19T05:40:24.757448+0000","last_clean":"2024-09-19T05:40:24.757448+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:40:24.757448+0000","last_undegraded":"2024-09-19T05:40:24.757448+0000","last_fullsized":"2024-09-19T05:40:24.757448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955324+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:38:28.955324+0000","last_peered":"2024-09-19T05:38:28.955324+0000","last_clean":"2024-09-19T05:38:28.955324+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:38:28.955324+0000","last_undegraded":"2024-09-19T05:38:28.955324+0000","last_fullsized":"2024-09-19T05:38:28.955324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695217+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:38:26.695217+0000","last_peered":"2024-09-19T05:38:26.695217+0000","last_clean":"2024-09-19T05:38:26.695217+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:38:26.695217+0000","last_undegraded":"2024-09-19T05:38:26.695217+0000","last_fullsized":"2024-09-19T05:38:26.695217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.760116+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:40:24.760116+0000","last_peered":"2024-09-19T05:40:24.760116+0000","last_clean":"2024-09-19T05:40:24.760116+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:40:24.760116+0000","last_undegraded":"2024-09-19T05:40:24.760116+0000","last_fullsized":"2024-09-19T05:40:24.760116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.951796+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:38:28.951796+0000","last_peered":"2024-09-19T05:38:28.951796+0000","last_clean":"2024-09-19T05:38:28.951796+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:38:28.951796+0000","last_undegraded":"2024-09-19T05:38:28.951796+0000","last_fullsized":"2024-09-19T05:38:28.951796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362359+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:38:26.362359+0000","last_peered":"2024-09-19T05:38:26.362359+0000","last_clean":"2024-09-19T05:38:26.362359+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:38:26.362359+0000","last_undegraded":"2024-09-19T05:38:26.362359+0000","last_fullsized":"2024-09-19T05:38:26.362359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758516+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:40:24.758516+0000","last_peered":"2024-09-19T05:40:24.758516+0000","last_clean":"2024-09-19T05:40:24.758516+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:40:24.758516+0000","last_undegraded":"2024-09-19T05:40:24.758516+0000","last_fullsized":"2024-09-19T05:40:24.758516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964847+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:38:25.964847+0000","last_peered":"2024-09-19T05:38:25.964847+0000","last_clean":"2024-09-19T05:38:25.964847+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:38:25.964847+0000","last_undegraded":"2024-09-19T05:38:25.964847+0000","last_fullsized":"2024-09-19T05:38:25.964847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964045+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:38:25.964045+0000","last_peered":"2024-09-19T05:38:25.964045+0000","last_clean":"2024-09-19T05:38:25.964045+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:38:25.964045+0000","last_undegraded":"2024-09-19T05:38:25.964045+0000","last_fullsized":"2024-09-19T05:38:25.964045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759461+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:40:24.759461+0000","last_peered":"2024-09-19T05:40:24.759461+0000","last_clean":"2024-09-19T05:40:24.759461+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:40:24.759461+0000","last_undegraded":"2024-09-19T05:40:24.759461+0000","last_fullsized":"2024-09-19T05:40:24.759461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'18","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.882182+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:39:45.882182+0000","last_peered":"2024-09-19T05:39:45.882182+0000","last_clean":"2024-09-19T05:39:45.882182+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:39:45.882182+0000","last_undegraded":"2024-09-19T05:39:45.882182+0000","last_fullsized":"2024-09-19T05:39:45.882182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695282+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:38:26.695282+0000","last_peered":"2024-09-19T05:38:26.695282+0000","last_clean":"2024-09-19T05:38:26.695282+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:38:26.695282+0000","last_undegraded":"2024-09-19T05:38:26.695282+0000","last_fullsized":"2024-09-19T05:38:26.695282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746363+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:40:24.746363+0000","last_peered":"2024-09-19T05:40:24.746363+0000","last_clean":"2024-09-19T05:40:24.746363+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:40:24.746363+0000","last_undegraded":"2024-09-19T05:40:24.746363+0000","last_fullsized":"2024-09-19T05:40:24.746363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:02.210594+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:40:02.210594+0000","last_peered":"2024-09-19T05:40:02.210594+0000","last_clean":"2024-09-19T05:40:02.210594+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:40:02.210594+0000","last_undegraded":"2024-09-19T05:40:02.210594+0000","last_fullsized":"2024-09-19T05:40:02.210594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966334+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:38:25.966334+0000","last_peered":"2024-09-19T05:38:25.966334+0000","last_clean":"2024-09-19T05:38:25.966334+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:38:25.966334+0000","last_undegraded":"2024-09-19T05:38:25.966334+0000","last_fullsized":"2024-09-19T05:38:25.966334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759895+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:40:24.759895+0000","last_peered":"2024-09-19T05:40:24.759895+0000","last_clean":"2024-09-19T05:40:24.759895+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:40:24.759895+0000","last_undegraded":"2024-09-19T05:40:24.759895+0000","last_fullsized":"2024-09-19T05:40:24.759895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888493+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:39:40.888493+0000","last_peered":"2024-09-19T05:39:40.888493+0000","last_clean":"2024-09-19T05:39:40.888493+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:39:40.888493+0000","last_undegraded":"2024-09-19T05:39:40.888493+0000","last_fullsized":"2024-09-19T05:39:40.888493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965580+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:38:25.965580+0000","last_peered":"2024-09-19T05:38:25.965580+0000","last_clean":"2024-09-19T05:38:25.965580+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:38:25.965580+0000","last_undegraded":"2024-09-19T05:38:25.965580+0000","last_fullsized":"2024-09-19T05:38:25.965580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763100+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:40:24.763100+0000","last_peered":"2024-09-19T05:40:24.763100+0000","last_clean":"2024-09-19T05:40:24.763100+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:40:24.763100+0000","last_undegraded":"2024-09-19T05:40:24.763100+0000","last_fullsized":"2024-09-19T05:40:24.763100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955469+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:38:28.955469+0000","last_peered":"2024-09-19T05:38:28.955469+0000","last_clean":"2024-09-19T05:38:28.955469+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:38:28.955469+0000","last_undegraded":"2024-09-19T05:38:28.955469+0000","last_fullsized":"2024-09-19T05:38:28.955469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363151+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:38:26.363151+0000","last_peered":"2024-09-19T05:38:26.363151+0000","last_clean":"2024-09-19T05:38:26.363151+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:38:26.363151+0000","last_undegraded":"2024-09-19T05:38:26.363151+0000","last_fullsized":"2024-09-19T05:38:26.363151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753826+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:40:24.753826+0000","last_peered":"2024-09-19T05:40:24.753826+0000","last_clean":"2024-09-19T05:40:24.753826+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:40:24.753826+0000","last_undegraded":"2024-09-19T05:40:24.753826+0000","last_fullsized":"2024-09-19T05:40:24.753826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'33","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.714069+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:40:24.714069+0000","last_peered":"2024-09-19T05:40:24.714069+0000","last_clean":"2024-09-19T05:40:24.714069+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:40:24.714069+0000","last_undegraded":"2024-09-19T05:40:24.714069+0000","last_fullsized":"2024-09-19T05:40:24.714069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888198+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:39:40.888198+0000","last_peered":"2024-09-19T05:39:40.888198+0000","last_clean":"2024-09-19T05:39:40.888198+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:39:40.888198+0000","last_undegraded":"2024-09-19T05:39:40.888198+0000","last_fullsized":"2024-09-19T05:39:40.888198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762696+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:40:24.762696+0000","last_peered":"2024-09-19T05:40:24.762696+0000","last_clean":"2024-09-19T05:40:24.762696+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:40:24.762696+0000","last_undegraded":"2024-09-19T05:40:24.762696+0000","last_fullsized":"2024-09-19T05:40:24.762696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.883954+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:39:45.883954+0000","last_peered":"2024-09-19T05:39:45.883954+0000","last_clean":"2024-09-19T05:39:45.883954+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:39:45.883954+0000","last_undegraded":"2024-09-19T05:39:45.883954+0000","last_fullsized":"2024-09-19T05:39:45.883954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964401+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:38:25.964401+0000","last_peered":"2024-09-19T05:38:25.964401+0000","last_clean":"2024-09-19T05:38:25.964401+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:38:25.964401+0000","last_undegraded":"2024-09-19T05:38:25.964401+0000","last_fullsized":"2024-09-19T05:38:25.964401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758824+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:40:24.758824+0000","last_peered":"2024-09-19T05:40:24.758824+0000","last_clean":"2024-09-19T05:40:24.758824+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:40:24.758824+0000","last_undegraded":"2024-09-19T05:40:24.758824+0000","last_fullsized":"2024-09-19T05:40:24.758824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955439+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:28.955439+0000","last_peered":"2024-09-19T05:38:28.955439+0000","last_clean":"2024-09-19T05:38:28.955439+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:28.955439+0000","last_undegraded":"2024-09-19T05:38:28.955439+0000","last_fullsized":"2024-09-19T05:38:28.955439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965127+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:38:25.965127+0000","last_peered":"2024-09-19T05:38:25.965127+0000","last_clean":"2024-09-19T05:38:25.965127+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:38:25.965127+0000","last_undegraded":"2024-09-19T05:38:25.965127+0000","last_fullsized":"2024-09-19T05:38:25.965127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751579+0000","last_change":"2024-09-19T05:38:26.669788+0000","last_active":"2024-09-19T05:40:24.751579+0000","last_peered":"2024-09-19T05:40:24.751579+0000","last_clean":"2024-09-19T05:40:24.751579+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:40:24.751579+0000","last_undegraded":"2024-09-19T05:40:24.751579+0000","last_fullsized":"2024-09-19T05:40:24.751579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.207435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.712502+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:40:24.712502+0000","last_peered":"2024-09-19T05:40:24.712502+0000","last_clean":"2024-09-19T05:40:24.712502+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:40:24.712502+0000","last_undegraded":"2024-09-19T05:40:24.712502+0000","last_fullsized":"2024-09-19T05:40:24.712502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965500+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:38:25.965500+0000","last_peered":"2024-09-19T05:38:25.965500+0000","last_clean":"2024-09-19T05:38:25.965500+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:38:25.965500+0000","last_undegraded":"2024-09-19T05:38:25.965500+0000","last_fullsized":"2024-09-19T05:38:25.965500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695207+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:38:26.695207+0000","last_peered":"2024-09-19T05:38:26.695207+0000","last_clean":"2024-09-19T05:38:26.695207+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:38:26.695207+0000","last_undegraded":"2024-09-19T05:38:26.695207+0000","last_fullsized":"2024-09-19T05:38:26.695207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750837+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:40:24.750837+0000","last_peered":"2024-09-19T05:40:24.750837+0000","last_clean":"2024-09-19T05:40:24.750837+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:40:24.750837+0000","last_undegraded":"2024-09-19T05:40:24.750837+0000","last_fullsized":"2024-09-19T05:40:24.750837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958056+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:38:28.958056+0000","last_peered":"2024-09-19T05:38:28.958056+0000","last_clean":"2024-09-19T05:38:28.958056+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:38:28.958056+0000","last_undegraded":"2024-09-19T05:38:28.958056+0000","last_fullsized":"2024-09-19T05:38:28.958056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697541+0000","last_change":"2024-09-19T05:38:26.696467+0000","last_active":"2024-09-19T05:38:26.697541+0000","last_peered":"2024-09-19T05:38:26.697541+0000","last_clean":"2024-09-19T05:38:26.697541+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:38:26.697541+0000","last_undegraded":"2024-09-19T05:38:26.697541+0000","last_fullsized":"2024-09-19T05:38:26.697541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:43.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750330+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:40:24.750330+0000","last_peered":"2024-09-19T05:40:24.750330+0000","last_clean":"2024-09-19T05:40:24.750330+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:40:24.750330+0000","last_undegraded":"2024-09-19T05:40:24.750330+0000","last_fullsized":"2024-09-19T05:40:24.750330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955735+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:38:28.955735+0000","last_peered":"2024-09-19T05:38:28.955735+0000","last_clean":"2024-09-19T05:38:28.955735+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:38:28.955735+0000","last_undegraded":"2024-09-19T05:38:28.955735+0000","last_fullsized":"2024-09-19T05:38:28.955735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965075+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:38:25.965075+0000","last_peered":"2024-09-19T05:38:25.965075+0000","last_clean":"2024-09-19T05:38:25.965075+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:38:25.965075+0000","last_undegraded":"2024-09-19T05:38:25.965075+0000","last_fullsized":"2024-09-19T05:38:25.965075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751479+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:40:24.751479+0000","last_peered":"2024-09-19T05:40:24.751479+0000","last_clean":"2024-09-19T05:40:24.751479+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:40:24.751479+0000","last_undegraded":"2024-09-19T05:40:24.751479+0000","last_fullsized":"2024-09-19T05:40:24.751479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965122+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:38:25.965122+0000","last_peered":"2024-09-19T05:38:25.965122+0000","last_clean":"2024-09-19T05:38:25.965122+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:38:25.965122+0000","last_undegraded":"2024-09-19T05:38:25.965122+0000","last_fullsized":"2024-09-19T05:38:25.965122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:12.207200+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:40:12.207200+0000","last_peered":"2024-09-19T05:40:12.207200+0000","last_clean":"2024-09-19T05:40:12.207200+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:40:12.207200+0000","last_undegraded":"2024-09-19T05:40:12.207200+0000","last_fullsized":"2024-09-19T05:40:12.207200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1206,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.738115+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:40:24.738115+0000","last_peered":"2024-09-19T05:40:24.738115+0000","last_clean":"2024-09-19T05:40:24.738115+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:40:24.738115+0000","last_undegraded":"2024-09-19T05:40:24.738115+0000","last_fullsized":"2024-09-19T05:40:24.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965158+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:38:25.965158+0000","last_peered":"2024-09-19T05:38:25.965158+0000","last_clean":"2024-09-19T05:38:25.965158+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:38:25.965158+0000","last_undegraded":"2024-09-19T05:38:25.965158+0000","last_fullsized":"2024-09-19T05:38:25.965158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750202+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:40:24.750202+0000","last_peered":"2024-09-19T05:40:24.750202+0000","last_clean":"2024-09-19T05:40:24.750202+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:40:24.750202+0000","last_undegraded":"2024-09-19T05:40:24.750202+0000","last_fullsized":"2024-09-19T05:40:24.750202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.737426+0000","last_change":"2024-09-19T05:38:25.967860+0000","last_active":"2024-09-19T05:40:24.737426+0000","last_peered":"2024-09-19T05:40:24.737426+0000","last_clean":"2024-09-19T05:40:24.737426+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:40:24.737426+0000","last_undegraded":"2024-09-19T05:40:24.737426+0000","last_fullsized":"2024-09-19T05:40:24.737426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:04.609599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757981+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:40:24.757981+0000","last_peered":"2024-09-19T05:40:24.757981+0000","last_clean":"2024-09-19T05:40:24.757981+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:40:24.757981+0000","last_undegraded":"2024-09-19T05:40:24.757981+0000","last_fullsized":"2024-09-19T05:40:24.757981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750483+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:40:24.750483+0000","last_peered":"2024-09-19T05:40:24.750483+0000","last_clean":"2024-09-19T05:40:24.750483+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:40:24.750483+0000","last_undegraded":"2024-09-19T05:40:24.750483+0000","last_fullsized":"2024-09-19T05:40:24.750483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744916+0000","last_change":"2024-09-19T05:38:25.967776+0000","last_active":"2024-09-19T05:40:24.744916+0000","last_peered":"2024-09-19T05:40:24.744916+0000","last_clean":"2024-09-19T05:40:24.744916+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:40:24.744916+0000","last_undegraded":"2024-09-19T05:40:24.744916+0000","last_fullsized":"2024-09-19T05:40:24.744916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:43.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746119+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:40:24.746119+0000","last_peered":"2024-09-19T05:40:24.746119+0000","last_clean":"2024-09-19T05:40:24.746119+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:40:24.746119+0000","last_undegraded":"2024-09-19T05:40:24.746119+0000","last_fullsized":"2024-09-19T05:40:24.746119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753563+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:40:24.753563+0000","last_peered":"2024-09-19T05:40:24.753563+0000","last_clean":"2024-09-19T05:40:24.753563+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:40:24.753563+0000","last_undegraded":"2024-09-19T05:40:24.753563+0000","last_fullsized":"2024-09-19T05:40:24.753563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748932+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:40:24.748932+0000","last_peered":"2024-09-19T05:40:24.748932+0000","last_clean":"2024-09-19T05:40:24.748932+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:40:24.748932+0000","last_undegraded":"2024-09-19T05:40:24.748932+0000","last_fullsized":"2024-09-19T05:40:24.748932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758003+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:40:24.758003+0000","last_peered":"2024-09-19T05:40:24.758003+0000","last_clean":"2024-09-19T05:40:24.758003+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:40:24.758003+0000","last_undegraded":"2024-09-19T05:40:24.758003+0000","last_fullsized":"2024-09-19T05:40:24.758003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751615+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:40:24.751615+0000","last_peered":"2024-09-19T05:40:24.751615+0000","last_clean":"2024-09-19T05:40:24.751615+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:40:24.751615+0000","last_undegraded":"2024-09-19T05:40:24.751615+0000","last_fullsized":"2024-09-19T05:40:24.751615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759252+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:40:24.759252+0000","last_peered":"2024-09-19T05:40:24.759252+0000","last_clean":"2024-09-19T05:40:24.759252+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:40:24.759252+0000","last_undegraded":"2024-09-19T05:40:24.759252+0000","last_fullsized":"2024-09-19T05:40:24.759252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763428+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:40:24.763428+0000","last_peered":"2024-09-19T05:40:24.763428+0000","last_clean":"2024-09-19T05:40:24.763428+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:40:24.763428+0000","last_undegraded":"2024-09-19T05:40:24.763428+0000","last_fullsized":"2024-09-19T05:40:24.763428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.749502+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:40:24.749502+0000","last_peered":"2024-09-19T05:40:24.749502+0000","last_clean":"2024-09-19T05:40:24.749502+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:40:24.749502+0000","last_undegraded":"2024-09-19T05:40:24.749502+0000","last_fullsized":"2024-09-19T05:40:24.749502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751376+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:40:24.751376+0000","last_peered":"2024-09-19T05:40:24.751376+0000","last_clean":"2024-09-19T05:40:24.751376+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:40:24.751376+0000","last_undegraded":"2024-09-19T05:40:24.751376+0000","last_fullsized":"2024-09-19T05:40:24.751376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.733287+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:40:24.733287+0000","last_peered":"2024-09-19T05:40:24.733287+0000","last_clean":"2024-09-19T05:40:24.733287+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:40:24.733287+0000","last_undegraded":"2024-09-19T05:40:24.733287+0000","last_fullsized":"2024-09-19T05:40:24.733287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757641+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:40:24.757641+0000","last_peered":"2024-09-19T05:40:24.757641+0000","last_clean":"2024-09-19T05:40:24.757641+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:40:24.757641+0000","last_undegraded":"2024-09-19T05:40:24.757641+0000","last_fullsized":"2024-09-19T05:40:24.757641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757694+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:40:24.757694+0000","last_peered":"2024-09-19T05:40:24.757694+0000","last_clean":"2024-09-19T05:40:24.757694+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:40:24.757694+0000","last_undegraded":"2024-09-19T05:40:24.757694+0000","last_fullsized":"2024-09-19T05:40:24.757694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747123+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:40:24.747123+0000","last_peered":"2024-09-19T05:40:24.747123+0000","last_clean":"2024-09-19T05:40:24.747123+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:40:24.747123+0000","last_undegraded":"2024-09-19T05:40:24.747123+0000","last_fullsized":"2024-09-19T05:40:24.747123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747557+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:40:24.747557+0000","last_peered":"2024-09-19T05:40:24.747557+0000","last_clean":"2024-09-19T05:40:24.747557+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:40:24.747557+0000","last_undegraded":"2024-09-19T05:40:24.747557+0000","last_fullsized":"2024-09-19T05:40:24.747557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754142+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:40:24.754142+0000","last_peered":"2024-09-19T05:40:24.754142+0000","last_clean":"2024-09-19T05:40:24.754142+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:40:24.754142+0000","last_undegraded":"2024-09-19T05:40:24.754142+0000","last_fullsized":"2024-09-19T05:40:24.754142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.740195+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:40:24.740195+0000","last_peered":"2024-09-19T05:40:24.740195+0000","last_clean":"2024-09-19T05:40:24.740195+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:40:24.740195+0000","last_undegraded":"2024-09-19T05:40:24.740195+0000","last_fullsized":"2024-09-19T05:40:24.740195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745746+0000","last_change":"2024-09-19T05:38:25.968706+0000","last_active":"2024-09-19T05:40:24.745746+0000","last_peered":"2024-09-19T05:40:24.745746+0000","last_clean":"2024-09-19T05:40:24.745746+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:40:24.745746+0000","last_undegraded":"2024-09-19T05:40:24.745746+0000","last_fullsized":"2024-09-19T05:40:24.745746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:52.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758868+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:40:24.758868+0000","last_peered":"2024-09-19T05:40:24.758868+0000","last_clean":"2024-09-19T05:40:24.758868+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:40:24.758868+0000","last_undegraded":"2024-09-19T05:40:24.758868+0000","last_fullsized":"2024-09-19T05:40:24.758868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758530+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:40:24.758530+0000","last_peered":"2024-09-19T05:40:24.758530+0000","last_clean":"2024-09-19T05:40:24.758530+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:40:24.758530+0000","last_undegraded":"2024-09-19T05:40:24.758530+0000","last_fullsized":"2024-09-19T05:40:24.758530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762985+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:40:24.762985+0000","last_peered":"2024-09-19T05:40:24.762985+0000","last_clean":"2024-09-19T05:40:24.762985+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:40:24.762985+0000","last_undegraded":"2024-09-19T05:40:24.762985+0000","last_fullsized":"2024-09-19T05:40:24.762985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.756104+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:40:24.756104+0000","last_peered":"2024-09-19T05:40:24.756104+0000","last_clean":"2024-09-19T05:40:24.756104+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:40:24.756104+0000","last_undegraded":"2024-09-19T05:40:24.756104+0000","last_fullsized":"2024-09-19T05:40:24.756104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759188+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:40:24.759188+0000","last_peered":"2024-09-19T05:40:24.759188+0000","last_clean":"2024-09-19T05:40:24.759188+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:40:24.759188+0000","last_undegraded":"2024-09-19T05:40:24.759188+0000","last_fullsized":"2024-09-19T05:40:24.759188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745715+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:40:24.745715+0000","last_peered":"2024-09-19T05:40:24.745715+0000","last_clean":"2024-09-19T05:40:24.745715+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:40:24.745715+0000","last_undegraded":"2024-09-19T05:40:24.745715+0000","last_fullsized":"2024-09-19T05:40:24.745715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758744+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:40:24.758744+0000","last_peered":"2024-09-19T05:40:24.758744+0000","last_clean":"2024-09-19T05:40:24.758744+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:40:24.758744+0000","last_undegraded":"2024-09-19T05:40:24.758744+0000","last_fullsized":"2024-09-19T05:40:24.758744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748250+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:40:24.748250+0000","last_peered":"2024-09-19T05:40:24.748250+0000","last_clean":"2024-09-19T05:40:24.748250+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:40:24.748250+0000","last_undegraded":"2024-09-19T05:40:24.748250+0000","last_fullsized":"2024-09-19T05:40:24.748250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746682+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:40:24.746682+0000","last_peered":"2024-09-19T05:40:24.746682+0000","last_clean":"2024-09-19T05:40:24.746682+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:40:24.746682+0000","last_undegraded":"2024-09-19T05:40:24.746682+0000","last_fullsized":"2024-09-19T05:40:24.746682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754945+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:40:24.754945+0000","last_peered":"2024-09-19T05:40:24.754945+0000","last_clean":"2024-09-19T05:40:24.754945+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:40:24.754945+0000","last_undegraded":"2024-09-19T05:40:24.754945+0000","last_fullsized":"2024-09-19T05:40:24.754945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49294,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":264,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":98588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718685,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":167715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":168161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":128091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":42528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:31.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:31.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.516+0000 7fd294ea5640 1 Processor -- start 2024-09-19T05:40:31.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.516+0000 7fd294ea5640 1 -- start start 2024-09-19T05:40:31.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.516+0000 7fd294ea5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd290152d20 0x7fd29006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd294ea5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd290158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd294ea5640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd29015c330 con 0x7fd290153100 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd294ea5640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd29015d190 con 0x7fd290152d20 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd294ea5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd29015c610 con 0x7fd29006ce10 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28e59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd290152d20 0x7fd29006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28e59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd290152d20 0x7fd29006c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39562/0 (socket says 172.21.15.103:39562) 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28e59c640 1 -- 172.21.15.103:0/3427611479 learned_addr learned my addr 172.21.15.103:0/3427611479 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28dd9b640 1 --1- 172.21.15.103:0/3427611479 >> v1:172.21.15.103:6789/0 conn(0x7fd290153100 0x7fd2900c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34970/0 (socket says 172.21.15.103:34970) 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28ed9d640 1 --2- 172.21.15.103:0/3427611479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd290158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28e59c640 1 -- 172.21.15.103:0/3427611479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 msgr2=0x7fd290158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28e59c640 1 --2- 172.21.15.103:0/3427611479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd290158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28e59c640 1 -- 172.21.15.103:0/3427611479 >> v1:172.21.15.103:6789/0 conn(0x7fd290153100 legacy=0x7fd2900c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.517+0000 7fd28e59c640 1 -- 172.21.15.103:0/3427611479 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29015c8f0 con 0x7fd290152d20 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd28e59c640 1 --2- 172.21.15.103:0/3427611479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd29006c8d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd288009e50 tx=0x7fd28802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af500b58a2f45219 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd28d59a640 1 -- 172.21.15.103:0/3427611479 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288036070 con 0x7fd290152d20 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd28d59a640 1 -- 172.21.15.103:0/3427611479 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd288031600 con 0x7fd290152d20 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd28d59a640 1 -- 172.21.15.103:0/3427611479 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2880319d0 con 0x7fd290152d20 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 -- 172.21.15.103:0/3427611479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 msgr2=0x7fd29006c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 --2- 172.21.15.103:0/3427611479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd29006c8d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd288009e50 tx=0x7fd28802a5f0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 -- 172.21.15.103:0/3427611479 shutdown_connections 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 --2- 172.21.15.103:0/3427611479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd290158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 --2- 172.21.15.103:0/3427611479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd29006c8d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 -- 172.21.15.103:0/3427611479 >> 172.21.15.103:0/3427611479 conn(0x7fd2900c9230 msgr2=0x7fd2900c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 -- 172.21.15.103:0/3427611479 shutdown_connections 2024-09-19T05:40:31.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.518+0000 7fd294ea5640 1 -- 172.21.15.103:0/3427611479 wait complete. 2024-09-19T05:40:31.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 Processor -- start 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 -- start start 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd2900cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd2900ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd290153100 0x7fd2901f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd2900c6370 con 0x7fd290152d20 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd29015ceb0 con 0x7fd290153100 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.520+0000 7fd294ea5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd2900c64f0 con 0x7fd29006ce10 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd2900ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd2900ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39566/0 (socket says 172.21.15.103:39566) 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 -- 172.21.15.103:0/1369087029 learned_addr learned my addr 172.21.15.103:0/1369087029 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28ed9d640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd290153100 0x7fd2901f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28e59c640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd2900cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 -- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 msgr2=0x7fd2900cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd2900cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 -- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd290153100 msgr2=0x7fd2901f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd290153100 0x7fd2901f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 -- 172.21.15.103:0/1369087029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2901f4d80 con 0x7fd290152d20 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd28dd9b640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd2900ccc70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd27800c400 tx=0x7fd27800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd286ffd640 1 -- 172.21.15.103:0/1369087029 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2780074e0 con 0x7fd290152d20 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd286ffd640 1 -- 172.21.15.103:0/1369087029 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd278007680 con 0x7fd290152d20 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd290159db0 con 0x7fd290152d20 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd286ffd640 1 -- 172.21.15.103:0/1369087029 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278004a00 con 0x7fd290152d20 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.521+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd290158890 con 0x7fd290152d20 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.522+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd290074480 con 0x7fd290152d20 2024-09-19T05:40:31.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.523+0000 7fd286ffd640 1 -- 172.21.15.103:0/1369087029 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd27801a020 con 0x7fd290152d20 2024-09-19T05:40:31.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.523+0000 7fd286ffd640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd27006c2b0 0x7fd27006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.523+0000 7fd286ffd640 1 -- 172.21.15.103:0/1369087029 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd27808b090 con 0x7fd290152d20 2024-09-19T05:40:31.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.523+0000 7fd28e59c640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd27006c2b0 0x7fd27006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.524+0000 7fd28e59c640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd27006c2b0 0x7fd27006e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd288033000 tx=0x7fd288009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.527+0000 7fd286ffd640 1 -- 172.21.15.103:0/1369087029 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd278059400 con 0x7fd290152d20 2024-09-19T05:40:31.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.690+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2900c5fe0 con 0x7fd27006c2b0 2024-09-19T05:40:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.698+0000 7fd286ffd640 1 -- 172.21.15.103:0/1369087029 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332906 (secure 0 0 0) 0x7fd2900c5fe0 con 0x7fd27006c2b0 2024-09-19T05:40:31.703 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:40:31.705 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd27006c2b0 msgr2=0x7fd27006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd27006c2b0 0x7fd27006e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd288033000 tx=0x7fd288009000 comp rx=0 tx=0).stop 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 msgr2=0x7fd2900ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd2900ccc70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd27800c400 tx=0x7fd27800c8c0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 shutdown_connections 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd27006c2b0 0x7fd27006e770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd290153100 0x7fd2901f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd290152d20 0x7fd2900ccc70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 --2- 172.21.15.103:0/1369087029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd29006ce10 0x7fd2900cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.701+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 >> 172.21.15.103:0/1369087029 conn(0x7fd2900c9230 msgr2=0x7fd290150860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.702+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 shutdown_connections 2024-09-19T05:40:31.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.702+0000 7fd294ea5640 1 -- 172.21.15.103:0/1369087029 wait complete. 2024-09-19T05:40:31.715 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-19T05:40:30.219778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639662,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":425,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2867200,"data_stored":2284388,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003633"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955735+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:38:28.955735+0000","last_peered":"2024-09-19T05:38:28.955735+0000","last_clean":"2024-09-19T05:38:28.955735+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:38:28.955735+0000","last_undegraded":"2024-09-19T05:38:28.955735+0000","last_fullsized":"2024-09-19T05:38:28.955735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744889+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:40:24.744889+0000","last_peered":"2024-09-19T05:40:24.744889+0000","last_clean":"2024-09-19T05:40:24.744889+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:40:24.744889+0000","last_undegraded":"2024-09-19T05:40:24.744889+0000","last_fullsized":"2024-09-19T05:40:24.744889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965402+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:38:25.965402+0000","last_peered":"2024-09-19T05:38:25.965402+0000","last_clean":"2024-09-19T05:38:25.965402+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:38:25.965402+0000","last_undegraded":"2024-09-19T05:38:25.965402+0000","last_fullsized":"2024-09-19T05:38:25.965402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966602+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:38:25.966602+0000","last_peered":"2024-09-19T05:38:25.966602+0000","last_clean":"2024-09-19T05:38:25.966602+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:38:25.966602+0000","last_undegraded":"2024-09-19T05:38:25.966602+0000","last_fullsized":"2024-09-19T05:38:25.966602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758565+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:40:24.758565+0000","last_peered":"2024-09-19T05:40:24.758565+0000","last_clean":"2024-09-19T05:40:24.758565+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:40:24.758565+0000","last_undegraded":"2024-09-19T05:40:24.758565+0000","last_fullsized":"2024-09-19T05:40:24.758565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963867+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:38:25.963867+0000","last_peered":"2024-09-19T05:38:25.963867+0000","last_clean":"2024-09-19T05:38:25.963867+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:38:25.963867+0000","last_undegraded":"2024-09-19T05:38:25.963867+0000","last_fullsized":"2024-09-19T05:38:25.963867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878401+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:39:40.878401+0000","last_peered":"2024-09-19T05:39:40.878401+0000","last_clean":"2024-09-19T05:39:40.878401+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:39:40.878401+0000","last_undegraded":"2024-09-19T05:39:40.878401+0000","last_fullsized":"2024-09-19T05:39:40.878401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758867+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:40:24.758867+0000","last_peered":"2024-09-19T05:40:24.758867+0000","last_clean":"2024-09-19T05:40:24.758867+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:40:24.758867+0000","last_undegraded":"2024-09-19T05:40:24.758867+0000","last_fullsized":"2024-09-19T05:40:24.758867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964212+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:38:25.964212+0000","last_peered":"2024-09-19T05:38:25.964212+0000","last_clean":"2024-09-19T05:38:25.964212+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:38:25.964212+0000","last_undegraded":"2024-09-19T05:38:25.964212+0000","last_fullsized":"2024-09-19T05:38:25.964212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.956064+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:38:28.956064+0000","last_peered":"2024-09-19T05:38:28.956064+0000","last_clean":"2024-09-19T05:38:28.956064+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:38:28.956064+0000","last_undegraded":"2024-09-19T05:38:28.956064+0000","last_fullsized":"2024-09-19T05:38:28.956064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758625+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:40:24.758625+0000","last_peered":"2024-09-19T05:40:24.758625+0000","last_clean":"2024-09-19T05:40:24.758625+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:40:24.758625+0000","last_undegraded":"2024-09-19T05:40:24.758625+0000","last_fullsized":"2024-09-19T05:40:24.758625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963776+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:38:25.963776+0000","last_peered":"2024-09-19T05:38:25.963776+0000","last_clean":"2024-09-19T05:38:25.963776+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:38:25.963776+0000","last_undegraded":"2024-09-19T05:38:25.963776+0000","last_fullsized":"2024-09-19T05:38:25.963776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751142+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:40:24.751142+0000","last_peered":"2024-09-19T05:40:24.751142+0000","last_clean":"2024-09-19T05:40:24.751142+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:40:24.751142+0000","last_undegraded":"2024-09-19T05:40:24.751142+0000","last_fullsized":"2024-09-19T05:40:24.751142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878423+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:39:40.878423+0000","last_peered":"2024-09-19T05:39:40.878423+0000","last_clean":"2024-09-19T05:39:40.878423+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:39:40.878423+0000","last_undegraded":"2024-09-19T05:39:40.878423+0000","last_fullsized":"2024-09-19T05:39:40.878423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964596+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:38:25.964596+0000","last_peered":"2024-09-19T05:38:25.964596+0000","last_clean":"2024-09-19T05:38:25.964596+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:38:25.964596+0000","last_undegraded":"2024-09-19T05:38:25.964596+0000","last_fullsized":"2024-09-19T05:38:25.964596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750298+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:40:24.750298+0000","last_peered":"2024-09-19T05:40:24.750298+0000","last_clean":"2024-09-19T05:40:24.750298+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:40:24.750298+0000","last_undegraded":"2024-09-19T05:40:24.750298+0000","last_fullsized":"2024-09-19T05:40:24.750298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:43.953488+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:39:43.953488+0000","last_peered":"2024-09-19T05:39:43.953488+0000","last_clean":"2024-09-19T05:39:43.953488+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:39:43.953488+0000","last_undegraded":"2024-09-19T05:39:43.953488+0000","last_fullsized":"2024-09-19T05:39:43.953488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964548+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:38:25.964548+0000","last_peered":"2024-09-19T05:38:25.964548+0000","last_clean":"2024-09-19T05:38:25.964548+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:38:25.964548+0000","last_undegraded":"2024-09-19T05:38:25.964548+0000","last_fullsized":"2024-09-19T05:38:25.964548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750263+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:40:24.750263+0000","last_peered":"2024-09-19T05:40:24.750263+0000","last_clean":"2024-09-19T05:40:24.750263+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:40:24.750263+0000","last_undegraded":"2024-09-19T05:40:24.750263+0000","last_fullsized":"2024-09-19T05:40:24.750263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955690+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:38:28.955690+0000","last_peered":"2024-09-19T05:38:28.955690+0000","last_clean":"2024-09-19T05:38:28.955690+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:38:28.955690+0000","last_undegraded":"2024-09-19T05:38:28.955690+0000","last_fullsized":"2024-09-19T05:38:28.955690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963574+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:38:25.963574+0000","last_peered":"2024-09-19T05:38:25.963574+0000","last_clean":"2024-09-19T05:38:25.963574+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:38:25.963574+0000","last_undegraded":"2024-09-19T05:38:25.963574+0000","last_fullsized":"2024-09-19T05:38:25.963574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.720132+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:40:24.720132+0000","last_peered":"2024-09-19T05:40:24.720132+0000","last_clean":"2024-09-19T05:40:24.720132+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:40:24.720132+0000","last_undegraded":"2024-09-19T05:40:24.720132+0000","last_fullsized":"2024-09-19T05:40:24.720132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668599+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:26.668599+0000","last_peered":"2024-09-19T05:38:26.668599+0000","last_clean":"2024-09-19T05:38:26.668599+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:26.668599+0000","last_undegraded":"2024-09-19T05:38:26.668599+0000","last_fullsized":"2024-09-19T05:38:26.668599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964806+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:38:25.964806+0000","last_peered":"2024-09-19T05:38:25.964806+0000","last_clean":"2024-09-19T05:38:25.964806+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:38:25.964806+0000","last_undegraded":"2024-09-19T05:38:25.964806+0000","last_fullsized":"2024-09-19T05:38:25.964806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747015+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:40:24.747015+0000","last_peered":"2024-09-19T05:40:24.747015+0000","last_clean":"2024-09-19T05:40:24.747015+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:40:24.747015+0000","last_undegraded":"2024-09-19T05:40:24.747015+0000","last_fullsized":"2024-09-19T05:40:24.747015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888103+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:39:40.888103+0000","last_peered":"2024-09-19T05:39:40.888103+0000","last_clean":"2024-09-19T05:39:40.888103+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:39:40.888103+0000","last_undegraded":"2024-09-19T05:39:40.888103+0000","last_fullsized":"2024-09-19T05:39:40.888103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964361+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:38:25.964361+0000","last_peered":"2024-09-19T05:38:25.964361+0000","last_clean":"2024-09-19T05:38:25.964361+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:38:25.964361+0000","last_undegraded":"2024-09-19T05:38:25.964361+0000","last_fullsized":"2024-09-19T05:38:25.964361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754785+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:40:24.754785+0000","last_peered":"2024-09-19T05:40:24.754785+0000","last_clean":"2024-09-19T05:40:24.754785+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:40:24.754785+0000","last_undegraded":"2024-09-19T05:40:24.754785+0000","last_fullsized":"2024-09-19T05:40:24.754785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.842259+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:39:45.842259+0000","last_peered":"2024-09-19T05:39:45.842259+0000","last_clean":"2024-09-19T05:39:45.842259+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:39:45.842259+0000","last_undegraded":"2024-09-19T05:39:45.842259+0000","last_fullsized":"2024-09-19T05:39:45.842259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.698091+0000","last_change":"2024-09-19T05:38:26.696320+0000","last_active":"2024-09-19T05:38:26.698091+0000","last_peered":"2024-09-19T05:38:26.698091+0000","last_clean":"2024-09-19T05:38:26.698091+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:38:26.698091+0000","last_undegraded":"2024-09-19T05:38:26.698091+0000","last_fullsized":"2024-09-19T05:38:26.698091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:33.249021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745141+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:40:24.745141+0000","last_peered":"2024-09-19T05:40:24.745141+0000","last_clean":"2024-09-19T05:40:24.745141+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:40:24.745141+0000","last_undegraded":"2024-09-19T05:40:24.745141+0000","last_fullsized":"2024-09-19T05:40:24.745141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954034+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:38:28.954034+0000","last_peered":"2024-09-19T05:38:28.954034+0000","last_clean":"2024-09-19T05:38:28.954034+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:38:28.954034+0000","last_undegraded":"2024-09-19T05:38:28.954034+0000","last_fullsized":"2024-09-19T05:38:28.954034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694996+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:38:26.694996+0000","last_peered":"2024-09-19T05:38:26.694996+0000","last_clean":"2024-09-19T05:38:26.694996+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:38:26.694996+0000","last_undegraded":"2024-09-19T05:38:26.694996+0000","last_fullsized":"2024-09-19T05:38:26.694996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758249+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:40:24.758249+0000","last_peered":"2024-09-19T05:40:24.758249+0000","last_clean":"2024-09-19T05:40:24.758249+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:40:24.758249+0000","last_undegraded":"2024-09-19T05:40:24.758249+0000","last_fullsized":"2024-09-19T05:40:24.758249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963778+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:38:25.963778+0000","last_peered":"2024-09-19T05:38:25.963778+0000","last_clean":"2024-09-19T05:38:25.963778+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:38:25.963778+0000","last_undegraded":"2024-09-19T05:38:25.963778+0000","last_fullsized":"2024-09-19T05:38:25.963778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963227+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:38:25.963227+0000","last_peered":"2024-09-19T05:38:25.963227+0000","last_clean":"2024-09-19T05:38:25.963227+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:38:25.963227+0000","last_undegraded":"2024-09-19T05:38:25.963227+0000","last_fullsized":"2024-09-19T05:38:25.963227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745710+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:40:24.745710+0000","last_peered":"2024-09-19T05:40:24.745710+0000","last_clean":"2024-09-19T05:40:24.745710+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:40:24.745710+0000","last_undegraded":"2024-09-19T05:40:24.745710+0000","last_fullsized":"2024-09-19T05:40:24.745710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958110+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:38:28.958110+0000","last_peered":"2024-09-19T05:38:28.958110+0000","last_clean":"2024-09-19T05:38:28.958110+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:38:28.958110+0000","last_undegraded":"2024-09-19T05:38:28.958110+0000","last_fullsized":"2024-09-19T05:38:28.958110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963683+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:38:25.963683+0000","last_peered":"2024-09-19T05:38:25.963683+0000","last_clean":"2024-09-19T05:38:25.963683+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:38:25.963683+0000","last_undegraded":"2024-09-19T05:38:25.963683+0000","last_fullsized":"2024-09-19T05:38:25.963683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.742108+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:40:24.742108+0000","last_peered":"2024-09-19T05:40:24.742108+0000","last_clean":"2024-09-19T05:40:24.742108+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:40:24.742108+0000","last_undegraded":"2024-09-19T05:40:24.742108+0000","last_fullsized":"2024-09-19T05:40:24.742108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'10","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:50.206587+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:39:50.206587+0000","last_peered":"2024-09-19T05:39:50.206587+0000","last_clean":"2024-09-19T05:39:50.206587+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:39:50.206587+0000","last_undegraded":"2024-09-19T05:39:50.206587+0000","last_fullsized":"2024-09-19T05:39:50.206587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963800+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:38:25.963800+0000","last_peered":"2024-09-19T05:38:25.963800+0000","last_clean":"2024-09-19T05:38:25.963800+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:38:25.963800+0000","last_undegraded":"2024-09-19T05:38:25.963800+0000","last_fullsized":"2024-09-19T05:38:25.963800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745854+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:40:24.745854+0000","last_peered":"2024-09-19T05:40:24.745854+0000","last_clean":"2024-09-19T05:40:24.745854+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:40:24.745854+0000","last_undegraded":"2024-09-19T05:40:24.745854+0000","last_fullsized":"2024-09-19T05:40:24.745854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.953555+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:38:28.953555+0000","last_peered":"2024-09-19T05:38:28.953555+0000","last_clean":"2024-09-19T05:38:28.953555+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:38:28.953555+0000","last_undegraded":"2024-09-19T05:38:28.953555+0000","last_fullsized":"2024-09-19T05:38:28.953555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695310+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:38:26.695310+0000","last_peered":"2024-09-19T05:38:26.695310+0000","last_clean":"2024-09-19T05:38:26.695310+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:38:26.695310+0000","last_undegraded":"2024-09-19T05:38:26.695310+0000","last_fullsized":"2024-09-19T05:38:26.695310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763014+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:40:24.763014+0000","last_peered":"2024-09-19T05:40:24.763014+0000","last_clean":"2024-09-19T05:40:24.763014+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:40:24.763014+0000","last_undegraded":"2024-09-19T05:40:24.763014+0000","last_fullsized":"2024-09-19T05:40:24.763014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954148+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:28.954148+0000","last_peered":"2024-09-19T05:38:28.954148+0000","last_clean":"2024-09-19T05:38:28.954148+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:28.954148+0000","last_undegraded":"2024-09-19T05:38:28.954148+0000","last_fullsized":"2024-09-19T05:38:28.954148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668707+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:38:26.668707+0000","last_peered":"2024-09-19T05:38:26.668707+0000","last_clean":"2024-09-19T05:38:26.668707+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:38:26.668707+0000","last_undegraded":"2024-09-19T05:38:26.668707+0000","last_fullsized":"2024-09-19T05:38:26.668707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963638+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:38:25.963638+0000","last_peered":"2024-09-19T05:38:25.963638+0000","last_clean":"2024-09-19T05:38:25.963638+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:38:25.963638+0000","last_undegraded":"2024-09-19T05:38:25.963638+0000","last_fullsized":"2024-09-19T05:38:25.963638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759101+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:40:24.759101+0000","last_peered":"2024-09-19T05:40:24.759101+0000","last_clean":"2024-09-19T05:40:24.759101+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:40:24.759101+0000","last_undegraded":"2024-09-19T05:40:24.759101+0000","last_fullsized":"2024-09-19T05:40:24.759101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.207954+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:40:00.207954+0000","last_peered":"2024-09-19T05:40:00.207954+0000","last_clean":"2024-09-19T05:40:00.207954+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:40:00.207954+0000","last_undegraded":"2024-09-19T05:40:00.207954+0000","last_fullsized":"2024-09-19T05:40:00.207954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697544+0000","last_change":"2024-09-19T05:38:26.696465+0000","last_active":"2024-09-19T05:38:26.697544+0000","last_peered":"2024-09-19T05:38:26.697544+0000","last_clean":"2024-09-19T05:38:26.697544+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:38:26.697544+0000","last_undegraded":"2024-09-19T05:38:26.697544+0000","last_fullsized":"2024-09-19T05:38:26.697544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:04.587288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757448+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:40:24.757448+0000","last_peered":"2024-09-19T05:40:24.757448+0000","last_clean":"2024-09-19T05:40:24.757448+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:40:24.757448+0000","last_undegraded":"2024-09-19T05:40:24.757448+0000","last_fullsized":"2024-09-19T05:40:24.757448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955324+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:38:28.955324+0000","last_peered":"2024-09-19T05:38:28.955324+0000","last_clean":"2024-09-19T05:38:28.955324+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:38:28.955324+0000","last_undegraded":"2024-09-19T05:38:28.955324+0000","last_fullsized":"2024-09-19T05:38:28.955324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695217+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:38:26.695217+0000","last_peered":"2024-09-19T05:38:26.695217+0000","last_clean":"2024-09-19T05:38:26.695217+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:38:26.695217+0000","last_undegraded":"2024-09-19T05:38:26.695217+0000","last_fullsized":"2024-09-19T05:38:26.695217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.760116+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:40:24.760116+0000","last_peered":"2024-09-19T05:40:24.760116+0000","last_clean":"2024-09-19T05:40:24.760116+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:40:24.760116+0000","last_undegraded":"2024-09-19T05:40:24.760116+0000","last_fullsized":"2024-09-19T05:40:24.760116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.951796+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:38:28.951796+0000","last_peered":"2024-09-19T05:38:28.951796+0000","last_clean":"2024-09-19T05:38:28.951796+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:38:28.951796+0000","last_undegraded":"2024-09-19T05:38:28.951796+0000","last_fullsized":"2024-09-19T05:38:28.951796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362359+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:38:26.362359+0000","last_peered":"2024-09-19T05:38:26.362359+0000","last_clean":"2024-09-19T05:38:26.362359+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:38:26.362359+0000","last_undegraded":"2024-09-19T05:38:26.362359+0000","last_fullsized":"2024-09-19T05:38:26.362359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758516+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:40:24.758516+0000","last_peered":"2024-09-19T05:40:24.758516+0000","last_clean":"2024-09-19T05:40:24.758516+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:40:24.758516+0000","last_undegraded":"2024-09-19T05:40:24.758516+0000","last_fullsized":"2024-09-19T05:40:24.758516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964847+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:38:25.964847+0000","last_peered":"2024-09-19T05:38:25.964847+0000","last_clean":"2024-09-19T05:38:25.964847+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:38:25.964847+0000","last_undegraded":"2024-09-19T05:38:25.964847+0000","last_fullsized":"2024-09-19T05:38:25.964847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964045+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:38:25.964045+0000","last_peered":"2024-09-19T05:38:25.964045+0000","last_clean":"2024-09-19T05:38:25.964045+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:38:25.964045+0000","last_undegraded":"2024-09-19T05:38:25.964045+0000","last_fullsized":"2024-09-19T05:38:25.964045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759461+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:40:24.759461+0000","last_peered":"2024-09-19T05:40:24.759461+0000","last_clean":"2024-09-19T05:40:24.759461+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:40:24.759461+0000","last_undegraded":"2024-09-19T05:40:24.759461+0000","last_fullsized":"2024-09-19T05:40:24.759461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'18","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.882182+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:39:45.882182+0000","last_peered":"2024-09-19T05:39:45.882182+0000","last_clean":"2024-09-19T05:39:45.882182+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:39:45.882182+0000","last_undegraded":"2024-09-19T05:39:45.882182+0000","last_fullsized":"2024-09-19T05:39:45.882182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695282+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:38:26.695282+0000","last_peered":"2024-09-19T05:38:26.695282+0000","last_clean":"2024-09-19T05:38:26.695282+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:38:26.695282+0000","last_undegraded":"2024-09-19T05:38:26.695282+0000","last_fullsized":"2024-09-19T05:38:26.695282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746363+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:40:24.746363+0000","last_peered":"2024-09-19T05:40:24.746363+0000","last_clean":"2024-09-19T05:40:24.746363+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:40:24.746363+0000","last_undegraded":"2024-09-19T05:40:24.746363+0000","last_fullsized":"2024-09-19T05:40:24.746363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:02.210594+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:40:02.210594+0000","last_peered":"2024-09-19T05:40:02.210594+0000","last_clean":"2024-09-19T05:40:02.210594+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:40:02.210594+0000","last_undegraded":"2024-09-19T05:40:02.210594+0000","last_fullsized":"2024-09-19T05:40:02.210594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966334+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:38:25.966334+0000","last_peered":"2024-09-19T05:38:25.966334+0000","last_clean":"2024-09-19T05:38:25.966334+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:38:25.966334+0000","last_undegraded":"2024-09-19T05:38:25.966334+0000","last_fullsized":"2024-09-19T05:38:25.966334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759895+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:40:24.759895+0000","last_peered":"2024-09-19T05:40:24.759895+0000","last_clean":"2024-09-19T05:40:24.759895+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:40:24.759895+0000","last_undegraded":"2024-09-19T05:40:24.759895+0000","last_fullsized":"2024-09-19T05:40:24.759895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888493+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:39:40.888493+0000","last_peered":"2024-09-19T05:39:40.888493+0000","last_clean":"2024-09-19T05:39:40.888493+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:39:40.888493+0000","last_undegraded":"2024-09-19T05:39:40.888493+0000","last_fullsized":"2024-09-19T05:39:40.888493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965580+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:38:25.965580+0000","last_peered":"2024-09-19T05:38:25.965580+0000","last_clean":"2024-09-19T05:38:25.965580+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:38:25.965580+0000","last_undegraded":"2024-09-19T05:38:25.965580+0000","last_fullsized":"2024-09-19T05:38:25.965580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763100+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:40:24.763100+0000","last_peered":"2024-09-19T05:40:24.763100+0000","last_clean":"2024-09-19T05:40:24.763100+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:40:24.763100+0000","last_undegraded":"2024-09-19T05:40:24.763100+0000","last_fullsized":"2024-09-19T05:40:24.763100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955469+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:38:28.955469+0000","last_peered":"2024-09-19T05:38:28.955469+0000","last_clean":"2024-09-19T05:38:28.955469+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:38:28.955469+0000","last_undegraded":"2024-09-19T05:38:28.955469+0000","last_fullsized":"2024-09-19T05:38:28.955469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363151+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:38:26.363151+0000","last_peered":"2024-09-19T05:38:26.363151+0000","last_clean":"2024-09-19T05:38:26.363151+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:38:26.363151+0000","last_undegraded":"2024-09-19T05:38:26.363151+0000","last_fullsized":"2024-09-19T05:38:26.363151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753826+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:40:24.753826+0000","last_peered":"2024-09-19T05:40:24.753826+0000","last_clean":"2024-09-19T05:40:24.753826+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:40:24.753826+0000","last_undegraded":"2024-09-19T05:40:24.753826+0000","last_fullsized":"2024-09-19T05:40:24.753826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'33","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.714069+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:40:24.714069+0000","last_peered":"2024-09-19T05:40:24.714069+0000","last_clean":"2024-09-19T05:40:24.714069+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:40:24.714069+0000","last_undegraded":"2024-09-19T05:40:24.714069+0000","last_fullsized":"2024-09-19T05:40:24.714069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888198+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:39:40.888198+0000","last_peered":"2024-09-19T05:39:40.888198+0000","last_clean":"2024-09-19T05:39:40.888198+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:39:40.888198+0000","last_undegraded":"2024-09-19T05:39:40.888198+0000","last_fullsized":"2024-09-19T05:39:40.888198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762696+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:40:24.762696+0000","last_peered":"2024-09-19T05:40:24.762696+0000","last_clean":"2024-09-19T05:40:24.762696+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:40:24.762696+0000","last_undegraded":"2024-09-19T05:40:24.762696+0000","last_fullsized":"2024-09-19T05:40:24.762696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.883954+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:39:45.883954+0000","last_peered":"2024-09-19T05:39:45.883954+0000","last_clean":"2024-09-19T05:39:45.883954+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:39:45.883954+0000","last_undegraded":"2024-09-19T05:39:45.883954+0000","last_fullsized":"2024-09-19T05:39:45.883954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964401+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:38:25.964401+0000","last_peered":"2024-09-19T05:38:25.964401+0000","last_clean":"2024-09-19T05:38:25.964401+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:38:25.964401+0000","last_undegraded":"2024-09-19T05:38:25.964401+0000","last_fullsized":"2024-09-19T05:38:25.964401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758824+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:40:24.758824+0000","last_peered":"2024-09-19T05:40:24.758824+0000","last_clean":"2024-09-19T05:40:24.758824+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:40:24.758824+0000","last_undegraded":"2024-09-19T05:40:24.758824+0000","last_fullsized":"2024-09-19T05:40:24.758824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955439+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:28.955439+0000","last_peered":"2024-09-19T05:38:28.955439+0000","last_clean":"2024-09-19T05:38:28.955439+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:28.955439+0000","last_undegraded":"2024-09-19T05:38:28.955439+0000","last_fullsized":"2024-09-19T05:38:28.955439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965127+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:38:25.965127+0000","last_peered":"2024-09-19T05:38:25.965127+0000","last_clean":"2024-09-19T05:38:25.965127+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:38:25.965127+0000","last_undegraded":"2024-09-19T05:38:25.965127+0000","last_fullsized":"2024-09-19T05:38:25.965127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751579+0000","last_change":"2024-09-19T05:38:26.669788+0000","last_active":"2024-09-19T05:40:24.751579+0000","last_peered":"2024-09-19T05:40:24.751579+0000","last_clean":"2024-09-19T05:40:24.751579+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:40:24.751579+0000","last_undegraded":"2024-09-19T05:40:24.751579+0000","last_fullsized":"2024-09-19T05:40:24.751579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.207435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.712502+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:40:24.712502+0000","last_peered":"2024-09-19T05:40:24.712502+0000","last_clean":"2024-09-19T05:40:24.712502+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:40:24.712502+0000","last_undegraded":"2024-09-19T05:40:24.712502+0000","last_fullsized":"2024-09-19T05:40:24.712502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965500+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:38:25.965500+0000","last_peered":"2024-09-19T05:38:25.965500+0000","last_clean":"2024-09-19T05:38:25.965500+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:38:25.965500+0000","last_undegraded":"2024-09-19T05:38:25.965500+0000","last_fullsized":"2024-09-19T05:38:25.965500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695207+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:38:26.695207+0000","last_peered":"2024-09-19T05:38:26.695207+0000","last_clean":"2024-09-19T05:38:26.695207+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:38:26.695207+0000","last_undegraded":"2024-09-19T05:38:26.695207+0000","last_fullsized":"2024-09-19T05:38:26.695207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750837+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:40:24.750837+0000","last_peered":"2024-09-19T05:40:24.750837+0000","last_clean":"2024-09-19T05:40:24.750837+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:40:24.750837+0000","last_undegraded":"2024-09-19T05:40:24.750837+0000","last_fullsized":"2024-09-19T05:40:24.750837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958056+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:38:28.958056+0000","last_peered":"2024-09-19T05:38:28.958056+0000","last_clean":"2024-09-19T05:38:28.958056+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:38:28.958056+0000","last_undegraded":"2024-09-19T05:38:28.958056+0000","last_fullsized":"2024-09-19T05:38:28.958056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697541+0000","last_change":"2024-09-19T05:38:26.696467+0000","last_active":"2024-09-19T05:38:26.697541+0000","last_peered":"2024-09-19T05:38:26.697541+0000","last_clean":"2024-09-19T05:38:26.697541+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:38:26.697541+0000","last_undegraded":"2024-09-19T05:38:26.697541+0000","last_fullsized":"2024-09-19T05:38:26.697541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:43.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750330+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:40:24.750330+0000","last_peered":"2024-09-19T05:40:24.750330+0000","last_clean":"2024-09-19T05:40:24.750330+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:40:24.750330+0000","last_undegraded":"2024-09-19T05:40:24.750330+0000","last_fullsized":"2024-09-19T05:40:24.750330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955735+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:38:28.955735+0000","last_peered":"2024-09-19T05:38:28.955735+0000","last_clean":"2024-09-19T05:38:28.955735+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:38:28.955735+0000","last_undegraded":"2024-09-19T05:38:28.955735+0000","last_fullsized":"2024-09-19T05:38:28.955735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965075+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:38:25.965075+0000","last_peered":"2024-09-19T05:38:25.965075+0000","last_clean":"2024-09-19T05:38:25.965075+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:38:25.965075+0000","last_undegraded":"2024-09-19T05:38:25.965075+0000","last_fullsized":"2024-09-19T05:38:25.965075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751479+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:40:24.751479+0000","last_peered":"2024-09-19T05:40:24.751479+0000","last_clean":"2024-09-19T05:40:24.751479+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:40:24.751479+0000","last_undegraded":"2024-09-19T05:40:24.751479+0000","last_fullsized":"2024-09-19T05:40:24.751479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965122+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:38:25.965122+0000","last_peered":"2024-09-19T05:38:25.965122+0000","last_clean":"2024-09-19T05:38:25.965122+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:38:25.965122+0000","last_undegraded":"2024-09-19T05:38:25.965122+0000","last_fullsized":"2024-09-19T05:38:25.965122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:12.207200+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:40:12.207200+0000","last_peered":"2024-09-19T05:40:12.207200+0000","last_clean":"2024-09-19T05:40:12.207200+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:40:12.207200+0000","last_undegraded":"2024-09-19T05:40:12.207200+0000","last_fullsized":"2024-09-19T05:40:12.207200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1206,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.738115+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:40:24.738115+0000","last_peered":"2024-09-19T05:40:24.738115+0000","last_clean":"2024-09-19T05:40:24.738115+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:40:24.738115+0000","last_undegraded":"2024-09-19T05:40:24.738115+0000","last_fullsized":"2024-09-19T05:40:24.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965158+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:38:25.965158+0000","last_peered":"2024-09-19T05:38:25.965158+0000","last_clean":"2024-09-19T05:38:25.965158+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:38:25.965158+0000","last_undegraded":"2024-09-19T05:38:25.965158+0000","last_fullsized":"2024-09-19T05:38:25.965158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750202+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:40:24.750202+0000","last_peered":"2024-09-19T05:40:24.750202+0000","last_clean":"2024-09-19T05:40:24.750202+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:40:24.750202+0000","last_undegraded":"2024-09-19T05:40:24.750202+0000","last_fullsized":"2024-09-19T05:40:24.750202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.737426+0000","last_change":"2024-09-19T05:38:25.967860+0000","last_active":"2024-09-19T05:40:24.737426+0000","last_peered":"2024-09-19T05:40:24.737426+0000","last_clean":"2024-09-19T05:40:24.737426+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:40:24.737426+0000","last_undegraded":"2024-09-19T05:40:24.737426+0000","last_fullsized":"2024-09-19T05:40:24.737426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:04.609599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757981+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:40:24.757981+0000","last_peered":"2024-09-19T05:40:24.757981+0000","last_clean":"2024-09-19T05:40:24.757981+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:40:24.757981+0000","last_undegraded":"2024-09-19T05:40:24.757981+0000","last_fullsized":"2024-09-19T05:40:24.757981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750483+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:40:24.750483+0000","last_peered":"2024-09-19T05:40:24.750483+0000","last_clean":"2024-09-19T05:40:24.750483+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:40:24.750483+0000","last_undegraded":"2024-09-19T05:40:24.750483+0000","last_fullsized":"2024-09-19T05:40:24.750483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744916+0000","last_change":"2024-09-19T05:38:25.967776+0000","last_active":"2024-09-19T05:40:24.744916+0000","last_peered":"2024-09-19T05:40:24.744916+0000","last_clean":"2024-09-19T05:40:24.744916+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:40:24.744916+0000","last_undegraded":"2024-09-19T05:40:24.744916+0000","last_fullsized":"2024-09-19T05:40:24.744916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:43.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746119+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:40:24.746119+0000","last_peered":"2024-09-19T05:40:24.746119+0000","last_clean":"2024-09-19T05:40:24.746119+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:40:24.746119+0000","last_undegraded":"2024-09-19T05:40:24.746119+0000","last_fullsized":"2024-09-19T05:40:24.746119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753563+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:40:24.753563+0000","last_peered":"2024-09-19T05:40:24.753563+0000","last_clean":"2024-09-19T05:40:24.753563+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:40:24.753563+0000","last_undegraded":"2024-09-19T05:40:24.753563+0000","last_fullsized":"2024-09-19T05:40:24.753563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748932+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:40:24.748932+0000","last_peered":"2024-09-19T05:40:24.748932+0000","last_clean":"2024-09-19T05:40:24.748932+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:40:24.748932+0000","last_undegraded":"2024-09-19T05:40:24.748932+0000","last_fullsized":"2024-09-19T05:40:24.748932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758003+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:40:24.758003+0000","last_peered":"2024-09-19T05:40:24.758003+0000","last_clean":"2024-09-19T05:40:24.758003+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:40:24.758003+0000","last_undegraded":"2024-09-19T05:40:24.758003+0000","last_fullsized":"2024-09-19T05:40:24.758003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751615+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:40:24.751615+0000","last_peered":"2024-09-19T05:40:24.751615+0000","last_clean":"2024-09-19T05:40:24.751615+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:40:24.751615+0000","last_undegraded":"2024-09-19T05:40:24.751615+0000","last_fullsized":"2024-09-19T05:40:24.751615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759252+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:40:24.759252+0000","last_peered":"2024-09-19T05:40:24.759252+0000","last_clean":"2024-09-19T05:40:24.759252+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:40:24.759252+0000","last_undegraded":"2024-09-19T05:40:24.759252+0000","last_fullsized":"2024-09-19T05:40:24.759252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763428+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:40:24.763428+0000","last_peered":"2024-09-19T05:40:24.763428+0000","last_clean":"2024-09-19T05:40:24.763428+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:40:24.763428+0000","last_undegraded":"2024-09-19T05:40:24.763428+0000","last_fullsized":"2024-09-19T05:40:24.763428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.749502+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:40:24.749502+0000","last_peered":"2024-09-19T05:40:24.749502+0000","last_clean":"2024-09-19T05:40:24.749502+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:40:24.749502+0000","last_undegraded":"2024-09-19T05:40:24.749502+0000","last_fullsized":"2024-09-19T05:40:24.749502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751376+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:40:24.751376+0000","last_peered":"2024-09-19T05:40:24.751376+0000","last_clean":"2024-09-19T05:40:24.751376+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:40:24.751376+0000","last_undegraded":"2024-09-19T05:40:24.751376+0000","last_fullsized":"2024-09-19T05:40:24.751376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.733287+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:40:24.733287+0000","last_peered":"2024-09-19T05:40:24.733287+0000","last_clean":"2024-09-19T05:40:24.733287+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:40:24.733287+0000","last_undegraded":"2024-09-19T05:40:24.733287+0000","last_fullsized":"2024-09-19T05:40:24.733287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757641+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:40:24.757641+0000","last_peered":"2024-09-19T05:40:24.757641+0000","last_clean":"2024-09-19T05:40:24.757641+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:40:24.757641+0000","last_undegraded":"2024-09-19T05:40:24.757641+0000","last_fullsized":"2024-09-19T05:40:24.757641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757694+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:40:24.757694+0000","last_peered":"2024-09-19T05:40:24.757694+0000","last_clean":"2024-09-19T05:40:24.757694+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:40:24.757694+0000","last_undegraded":"2024-09-19T05:40:24.757694+0000","last_fullsized":"2024-09-19T05:40:24.757694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747123+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:40:24.747123+0000","last_peered":"2024-09-19T05:40:24.747123+0000","last_clean":"2024-09-19T05:40:24.747123+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:40:24.747123+0000","last_undegraded":"2024-09-19T05:40:24.747123+0000","last_fullsized":"2024-09-19T05:40:24.747123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747557+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:40:24.747557+0000","last_peered":"2024-09-19T05:40:24.747557+0000","last_clean":"2024-09-19T05:40:24.747557+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:40:24.747557+0000","last_undegraded":"2024-09-19T05:40:24.747557+0000","last_fullsized":"2024-09-19T05:40:24.747557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754142+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:40:24.754142+0000","last_peered":"2024-09-19T05:40:24.754142+0000","last_clean":"2024-09-19T05:40:24.754142+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:40:24.754142+0000","last_undegraded":"2024-09-19T05:40:24.754142+0000","last_fullsized":"2024-09-19T05:40:24.754142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.740195+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:40:24.740195+0000","last_peered":"2024-09-19T05:40:24.740195+0000","last_clean":"2024-09-19T05:40:24.740195+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:40:24.740195+0000","last_undegraded":"2024-09-19T05:40:24.740195+0000","last_fullsized":"2024-09-19T05:40:24.740195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745746+0000","last_change":"2024-09-19T05:38:25.968706+0000","last_active":"2024-09-19T05:40:24.745746+0000","last_peered":"2024-09-19T05:40:24.745746+0000","last_clean":"2024-09-19T05:40:24.745746+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:40:24.745746+0000","last_undegraded":"2024-09-19T05:40:24.745746+0000","last_fullsized":"2024-09-19T05:40:24.745746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:52.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758868+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:40:24.758868+0000","last_peered":"2024-09-19T05:40:24.758868+0000","last_clean":"2024-09-19T05:40:24.758868+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:40:24.758868+0000","last_undegraded":"2024-09-19T05:40:24.758868+0000","last_fullsized":"2024-09-19T05:40:24.758868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758530+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:40:24.758530+0000","last_peered":"2024-09-19T05:40:24.758530+0000","last_clean":"2024-09-19T05:40:24.758530+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:40:24.758530+0000","last_undegraded":"2024-09-19T05:40:24.758530+0000","last_fullsized":"2024-09-19T05:40:24.758530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762985+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:40:24.762985+0000","last_peered":"2024-09-19T05:40:24.762985+0000","last_clean":"2024-09-19T05:40:24.762985+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:40:24.762985+0000","last_undegraded":"2024-09-19T05:40:24.762985+0000","last_fullsized":"2024-09-19T05:40:24.762985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.756104+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:40:24.756104+0000","last_peered":"2024-09-19T05:40:24.756104+0000","last_clean":"2024-09-19T05:40:24.756104+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:40:24.756104+0000","last_undegraded":"2024-09-19T05:40:24.756104+0000","last_fullsized":"2024-09-19T05:40:24.756104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759188+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:40:24.759188+0000","last_peered":"2024-09-19T05:40:24.759188+0000","last_clean":"2024-09-19T05:40:24.759188+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:40:24.759188+0000","last_undegraded":"2024-09-19T05:40:24.759188+0000","last_fullsized":"2024-09-19T05:40:24.759188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745715+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:40:24.745715+0000","last_peered":"2024-09-19T05:40:24.745715+0000","last_clean":"2024-09-19T05:40:24.745715+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:40:24.745715+0000","last_undegraded":"2024-09-19T05:40:24.745715+0000","last_fullsized":"2024-09-19T05:40:24.745715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758744+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:40:24.758744+0000","last_peered":"2024-09-19T05:40:24.758744+0000","last_clean":"2024-09-19T05:40:24.758744+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:40:24.758744+0000","last_undegraded":"2024-09-19T05:40:24.758744+0000","last_fullsized":"2024-09-19T05:40:24.758744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748250+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:40:24.748250+0000","last_peered":"2024-09-19T05:40:24.748250+0000","last_clean":"2024-09-19T05:40:24.748250+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:40:24.748250+0000","last_undegraded":"2024-09-19T05:40:24.748250+0000","last_fullsized":"2024-09-19T05:40:24.748250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746682+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:40:24.746682+0000","last_peered":"2024-09-19T05:40:24.746682+0000","last_clean":"2024-09-19T05:40:24.746682+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:40:24.746682+0000","last_undegraded":"2024-09-19T05:40:24.746682+0000","last_fullsized":"2024-09-19T05:40:24.746682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754945+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:40:24.754945+0000","last_peered":"2024-09-19T05:40:24.754945+0000","last_clean":"2024-09-19T05:40:24.754945+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:40:24.754945+0000","last_undegraded":"2024-09-19T05:40:24.754945+0000","last_fullsized":"2024-09-19T05:40:24.754945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49294,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":264,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":98588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718685,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":167715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":168161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":128091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":42528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:31.720 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T05:40:31.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:31.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.853+0000 7fd8c0ee6640 1 Processor -- start 2024-09-19T05:40:31.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.853+0000 7fd8c0ee6640 1 -- start start 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8c0ee6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8bc0cab90 0x7fd8bc15c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8c0ee6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd8bc15c780 0x7fd8bc0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8c0ee6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8bc074350 con 0x7fd8bc152f00 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8c0ee6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd8bc0c8cc0 con 0x7fd8bc0cab90 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8c0ee6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fd8bc074610 con 0x7fd8bc15c780 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8b1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8bc0cab90 0x7fd8bc15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8b1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8bc0cab90 0x7fd8bc15c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39568/0 (socket says 172.21.15.103:39568) 2024-09-19T05:40:31.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8b1d9b640 1 -- 172.21.15.103:0/1968669615 learned_addr learned my addr 172.21.15.103:0/1968669615 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:31.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8b1d9b640 1 -- 172.21.15.103:0/1968669615 >> v2:172.21.15.174:3300/0 conn(0x7fd8bc15c780 msgr2=0x7fd8bc0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:31.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8b1d9b640 1 --2- 172.21.15.103:0/1968669615 >> v2:172.21.15.174:3300/0 conn(0x7fd8bc15c780 0x7fd8bc0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8b1d9b640 1 -- 172.21.15.103:0/1968669615 >> v1:172.21.15.103:6789/0 conn(0x7fd8bc152f00 legacy=0x7fd8bc073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.854+0000 7fd8b1d9b640 1 -- 172.21.15.103:0/1968669615 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc0c7f00 con 0x7fd8bc0cab90 2024-09-19T05:40:31.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.855+0000 7fd8b1d9b640 1 --2- 172.21.15.103:0/1968669615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc15c240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0cc600 tx=0x7fd8a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88bb370b53830b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.855+0000 7fd8b9d9b640 1 -- 172.21.15.103:0/1968669615 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4037070 con 0x7fd8bc0cab90 2024-09-19T05:40:31.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.855+0000 7fd8b9d9b640 1 -- 172.21.15.103:0/1968669615 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a4032440 con 0x7fd8bc0cab90 2024-09-19T05:40:31.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.855+0000 7fd8b9d9b640 1 -- 172.21.15.103:0/1968669615 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4032810 con 0x7fd8bc0cab90 2024-09-19T05:40:31.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/1968669615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 msgr2=0x7fd8bc15c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/1968669615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc15c240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0cc600 tx=0x7fd8a402a270 comp rx=0 tx=0).stop 2024-09-19T05:40:31.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/1968669615 shutdown_connections 2024-09-19T05:40:31.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/1968669615 >> v2:172.21.15.174:3300/0 conn(0x7fd8bc15c780 0x7fd8bc0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/1968669615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc15c240 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/1968669615 >> 172.21.15.103:0/1968669615 conn(0x7fd8bc06c240 msgr2=0x7fd8bc067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:31.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/1968669615 shutdown_connections 2024-09-19T05:40:31.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.856+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/1968669615 wait complete. 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.857+0000 7fd8c0ee6640 1 Processor -- start 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.857+0000 7fd8c0ee6640 1 -- start start 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8c0ee6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8c0ee6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc152f00 0x7fd8bc158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8c0ee6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc15c780 0x7fd8bc155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8c0ee6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc0c87a0 con 0x7fd8bc0cab90 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8c0ee6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc0c84c0 con 0x7fd8bc152f00 2024-09-19T05:40:31.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8c0ee6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd8bc073710 con 0x7fd8bc15c780 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39572/0 (socket says 172.21.15.103:39572) 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 -- 172.21.15.103:0/2633752060 learned_addr learned my addr 172.21.15.103:0/2633752060 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8bad9d640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc15c780 0x7fd8bc155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8b1d9b640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc152f00 0x7fd8bc158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 -- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc15c780 msgr2=0x7fd8bc155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc15c780 0x7fd8bc155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 -- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc152f00 msgr2=0x7fd8bc158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc152f00 0x7fd8bc158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.858+0000 7fd8ba59c640 1 -- 172.21.15.103:0/2633752060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc15a3e0 con 0x7fd8bc0cab90 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.859+0000 7fd8ba59c640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc159ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c430 tx=0x7fd8ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.859+0000 7fd8b37fe640 1 -- 172.21.15.103:0/2633752060 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0052d0 con 0x7fd8bc0cab90 2024-09-19T05:40:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.859+0000 7fd8b37fe640 1 -- 172.21.15.103:0/2633752060 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac005490 con 0x7fd8bc0cab90 2024-09-19T05:40:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.859+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8bc1eeed0 con 0x7fd8bc0cab90 2024-09-19T05:40:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.859+0000 7fd8b37fe640 1 -- 172.21.15.103:0/2633752060 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac007260 con 0x7fd8bc0cab90 2024-09-19T05:40:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.859+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8bc1f1cb0 con 0x7fd8bc0cab90 2024-09-19T05:40:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.860+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8bc1532e0 con 0x7fd8bc0cab90 2024-09-19T05:40:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.860+0000 7fd8b37fe640 1 -- 172.21.15.103:0/2633752060 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd8ac007400 con 0x7fd8bc0cab90 2024-09-19T05:40:31.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.861+0000 7fd8b37fe640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd89c06c2e0 0x7fd89c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:31.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.861+0000 7fd8b37fe640 1 -- 172.21.15.103:0/2633752060 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd8ac08ad70 con 0x7fd8bc0cab90 2024-09-19T05:40:31.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.861+0000 7fd8b1d9b640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd89c06c2e0 0x7fd89c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:31.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.861+0000 7fd8b1d9b640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd89c06c2e0 0x7fd89c06e7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4034000 tx=0x7fd8a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:31.865+0000 7fd8b37fe640 1 -- 172.21.15.103:0/2633752060 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd8ac0590e0 con 0x7fd8bc0cab90 2024-09-19T05:40:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.029+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8bc1ef1b0 con 0x7fd89c06c2e0 2024-09-19T05:40:32.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.037+0000 7fd8b37fe640 1 -- 172.21.15.103:0/2633752060 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332906 (secure 0 0 0) 0x7fd8a4093480 con 0x7fd89c06c2e0 2024-09-19T05:40:32.042 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:40:32.044 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:40:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd89c06c2e0 msgr2=0x7fd89c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd89c06c2e0 0x7fd89c06e7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4034000 tx=0x7fd8a402e000 comp rx=0 tx=0).stop 2024-09-19T05:40:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 msgr2=0x7fd8bc159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc159ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c430 tx=0x7fd8ac00c8f0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 shutdown_connections 2024-09-19T05:40:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd89c06c2e0 0x7fd89c06e7a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc15c780 0x7fd8bc155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc152f00 0x7fd8bc158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 --2- 172.21.15.103:0/2633752060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8bc0cab90 0x7fd8bc159ea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 >> 172.21.15.103:0/2633752060 conn(0x7fd8bc06c240 msgr2=0x7fd8bc067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 shutdown_connections 2024-09-19T05:40:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.040+0000 7fd8c0ee6640 1 -- 172.21.15.103:0/2633752060 wait complete. 2024-09-19T05:40:32.053 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-19T05:40:30.219778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639662,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":425,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2867200,"data_stored":2284388,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003633"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955735+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:38:28.955735+0000","last_peered":"2024-09-19T05:38:28.955735+0000","last_clean":"2024-09-19T05:38:28.955735+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:38:28.955735+0000","last_undegraded":"2024-09-19T05:38:28.955735+0000","last_fullsized":"2024-09-19T05:38:28.955735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:52.246971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744889+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:40:24.744889+0000","last_peered":"2024-09-19T05:40:24.744889+0000","last_clean":"2024-09-19T05:40:24.744889+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:40:24.744889+0000","last_undegraded":"2024-09-19T05:40:24.744889+0000","last_fullsized":"2024-09-19T05:40:24.744889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965402+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:38:25.965402+0000","last_peered":"2024-09-19T05:38:25.965402+0000","last_clean":"2024-09-19T05:38:25.965402+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:38:25.965402+0000","last_undegraded":"2024-09-19T05:38:25.965402+0000","last_fullsized":"2024-09-19T05:38:25.965402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966602+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:38:25.966602+0000","last_peered":"2024-09-19T05:38:25.966602+0000","last_clean":"2024-09-19T05:38:25.966602+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:38:25.966602+0000","last_undegraded":"2024-09-19T05:38:25.966602+0000","last_fullsized":"2024-09-19T05:38:25.966602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758565+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:40:24.758565+0000","last_peered":"2024-09-19T05:40:24.758565+0000","last_clean":"2024-09-19T05:40:24.758565+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:40:24.758565+0000","last_undegraded":"2024-09-19T05:40:24.758565+0000","last_fullsized":"2024-09-19T05:40:24.758565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:30.357301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963867+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:38:25.963867+0000","last_peered":"2024-09-19T05:38:25.963867+0000","last_clean":"2024-09-19T05:38:25.963867+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:38:25.963867+0000","last_undegraded":"2024-09-19T05:38:25.963867+0000","last_fullsized":"2024-09-19T05:38:25.963867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878401+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:39:40.878401+0000","last_peered":"2024-09-19T05:39:40.878401+0000","last_clean":"2024-09-19T05:39:40.878401+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:39:40.878401+0000","last_undegraded":"2024-09-19T05:39:40.878401+0000","last_fullsized":"2024-09-19T05:39:40.878401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758867+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:40:24.758867+0000","last_peered":"2024-09-19T05:40:24.758867+0000","last_clean":"2024-09-19T05:40:24.758867+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:40:24.758867+0000","last_undegraded":"2024-09-19T05:40:24.758867+0000","last_fullsized":"2024-09-19T05:40:24.758867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964212+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:38:25.964212+0000","last_peered":"2024-09-19T05:38:25.964212+0000","last_clean":"2024-09-19T05:38:25.964212+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:38:25.964212+0000","last_undegraded":"2024-09-19T05:38:25.964212+0000","last_fullsized":"2024-09-19T05:38:25.964212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.956064+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:38:28.956064+0000","last_peered":"2024-09-19T05:38:28.956064+0000","last_clean":"2024-09-19T05:38:28.956064+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:38:28.956064+0000","last_undegraded":"2024-09-19T05:38:28.956064+0000","last_fullsized":"2024-09-19T05:38:28.956064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758625+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:40:24.758625+0000","last_peered":"2024-09-19T05:40:24.758625+0000","last_clean":"2024-09-19T05:40:24.758625+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:40:24.758625+0000","last_undegraded":"2024-09-19T05:40:24.758625+0000","last_fullsized":"2024-09-19T05:40:24.758625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963776+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:38:25.963776+0000","last_peered":"2024-09-19T05:38:25.963776+0000","last_clean":"2024-09-19T05:38:25.963776+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:38:25.963776+0000","last_undegraded":"2024-09-19T05:38:25.963776+0000","last_fullsized":"2024-09-19T05:38:25.963776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751142+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:40:24.751142+0000","last_peered":"2024-09-19T05:40:24.751142+0000","last_clean":"2024-09-19T05:40:24.751142+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:40:24.751142+0000","last_undegraded":"2024-09-19T05:40:24.751142+0000","last_fullsized":"2024-09-19T05:40:24.751142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878423+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:39:40.878423+0000","last_peered":"2024-09-19T05:39:40.878423+0000","last_clean":"2024-09-19T05:39:40.878423+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:39:40.878423+0000","last_undegraded":"2024-09-19T05:39:40.878423+0000","last_fullsized":"2024-09-19T05:39:40.878423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964596+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:38:25.964596+0000","last_peered":"2024-09-19T05:38:25.964596+0000","last_clean":"2024-09-19T05:38:25.964596+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:38:25.964596+0000","last_undegraded":"2024-09-19T05:38:25.964596+0000","last_fullsized":"2024-09-19T05:38:25.964596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750298+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:40:24.750298+0000","last_peered":"2024-09-19T05:40:24.750298+0000","last_clean":"2024-09-19T05:40:24.750298+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:40:24.750298+0000","last_undegraded":"2024-09-19T05:40:24.750298+0000","last_fullsized":"2024-09-19T05:40:24.750298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:43.953488+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:39:43.953488+0000","last_peered":"2024-09-19T05:39:43.953488+0000","last_clean":"2024-09-19T05:39:43.953488+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:39:43.953488+0000","last_undegraded":"2024-09-19T05:39:43.953488+0000","last_fullsized":"2024-09-19T05:39:43.953488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964548+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:38:25.964548+0000","last_peered":"2024-09-19T05:38:25.964548+0000","last_clean":"2024-09-19T05:38:25.964548+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:38:25.964548+0000","last_undegraded":"2024-09-19T05:38:25.964548+0000","last_fullsized":"2024-09-19T05:38:25.964548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750263+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:40:24.750263+0000","last_peered":"2024-09-19T05:40:24.750263+0000","last_clean":"2024-09-19T05:40:24.750263+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:40:24.750263+0000","last_undegraded":"2024-09-19T05:40:24.750263+0000","last_fullsized":"2024-09-19T05:40:24.750263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955690+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:38:28.955690+0000","last_peered":"2024-09-19T05:38:28.955690+0000","last_clean":"2024-09-19T05:38:28.955690+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:38:28.955690+0000","last_undegraded":"2024-09-19T05:38:28.955690+0000","last_fullsized":"2024-09-19T05:38:28.955690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:20.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963574+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:38:25.963574+0000","last_peered":"2024-09-19T05:38:25.963574+0000","last_clean":"2024-09-19T05:38:25.963574+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:38:25.963574+0000","last_undegraded":"2024-09-19T05:38:25.963574+0000","last_fullsized":"2024-09-19T05:38:25.963574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:20.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.720132+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:40:24.720132+0000","last_peered":"2024-09-19T05:40:24.720132+0000","last_clean":"2024-09-19T05:40:24.720132+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:40:24.720132+0000","last_undegraded":"2024-09-19T05:40:24.720132+0000","last_fullsized":"2024-09-19T05:40:24.720132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668599+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:26.668599+0000","last_peered":"2024-09-19T05:38:26.668599+0000","last_clean":"2024-09-19T05:38:26.668599+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:26.668599+0000","last_undegraded":"2024-09-19T05:38:26.668599+0000","last_fullsized":"2024-09-19T05:38:26.668599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964806+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:38:25.964806+0000","last_peered":"2024-09-19T05:38:25.964806+0000","last_clean":"2024-09-19T05:38:25.964806+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:38:25.964806+0000","last_undegraded":"2024-09-19T05:38:25.964806+0000","last_fullsized":"2024-09-19T05:38:25.964806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747015+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:40:24.747015+0000","last_peered":"2024-09-19T05:40:24.747015+0000","last_clean":"2024-09-19T05:40:24.747015+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:40:24.747015+0000","last_undegraded":"2024-09-19T05:40:24.747015+0000","last_fullsized":"2024-09-19T05:40:24.747015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:32.633920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888103+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:39:40.888103+0000","last_peered":"2024-09-19T05:39:40.888103+0000","last_clean":"2024-09-19T05:39:40.888103+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:39:40.888103+0000","last_undegraded":"2024-09-19T05:39:40.888103+0000","last_fullsized":"2024-09-19T05:39:40.888103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964361+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:38:25.964361+0000","last_peered":"2024-09-19T05:38:25.964361+0000","last_clean":"2024-09-19T05:38:25.964361+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:38:25.964361+0000","last_undegraded":"2024-09-19T05:38:25.964361+0000","last_fullsized":"2024-09-19T05:38:25.964361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754785+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:40:24.754785+0000","last_peered":"2024-09-19T05:40:24.754785+0000","last_clean":"2024-09-19T05:40:24.754785+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:40:24.754785+0000","last_undegraded":"2024-09-19T05:40:24.754785+0000","last_fullsized":"2024-09-19T05:40:24.754785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.842259+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:39:45.842259+0000","last_peered":"2024-09-19T05:39:45.842259+0000","last_clean":"2024-09-19T05:39:45.842259+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:39:45.842259+0000","last_undegraded":"2024-09-19T05:39:45.842259+0000","last_fullsized":"2024-09-19T05:39:45.842259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:29.159161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.698091+0000","last_change":"2024-09-19T05:38:26.696320+0000","last_active":"2024-09-19T05:38:26.698091+0000","last_peered":"2024-09-19T05:38:26.698091+0000","last_clean":"2024-09-19T05:38:26.698091+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:38:26.698091+0000","last_undegraded":"2024-09-19T05:38:26.698091+0000","last_fullsized":"2024-09-19T05:38:26.698091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:33.249021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745141+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:40:24.745141+0000","last_peered":"2024-09-19T05:40:24.745141+0000","last_clean":"2024-09-19T05:40:24.745141+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:40:24.745141+0000","last_undegraded":"2024-09-19T05:40:24.745141+0000","last_fullsized":"2024-09-19T05:40:24.745141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:14.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954034+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:38:28.954034+0000","last_peered":"2024-09-19T05:38:28.954034+0000","last_clean":"2024-09-19T05:38:28.954034+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:38:28.954034+0000","last_undegraded":"2024-09-19T05:38:28.954034+0000","last_fullsized":"2024-09-19T05:38:28.954034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.694996+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:38:26.694996+0000","last_peered":"2024-09-19T05:38:26.694996+0000","last_clean":"2024-09-19T05:38:26.694996+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:38:26.694996+0000","last_undegraded":"2024-09-19T05:38:26.694996+0000","last_fullsized":"2024-09-19T05:38:26.694996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:17.261871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758249+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:40:24.758249+0000","last_peered":"2024-09-19T05:40:24.758249+0000","last_clean":"2024-09-19T05:40:24.758249+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:40:24.758249+0000","last_undegraded":"2024-09-19T05:40:24.758249+0000","last_fullsized":"2024-09-19T05:40:24.758249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963778+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:38:25.963778+0000","last_peered":"2024-09-19T05:38:25.963778+0000","last_clean":"2024-09-19T05:38:25.963778+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:38:25.963778+0000","last_undegraded":"2024-09-19T05:38:25.963778+0000","last_fullsized":"2024-09-19T05:38:25.963778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:53.616206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963227+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:38:25.963227+0000","last_peered":"2024-09-19T05:38:25.963227+0000","last_clean":"2024-09-19T05:38:25.963227+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:38:25.963227+0000","last_undegraded":"2024-09-19T05:38:25.963227+0000","last_fullsized":"2024-09-19T05:38:25.963227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:42.063591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745710+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:40:24.745710+0000","last_peered":"2024-09-19T05:40:24.745710+0000","last_clean":"2024-09-19T05:40:24.745710+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:40:24.745710+0000","last_undegraded":"2024-09-19T05:40:24.745710+0000","last_fullsized":"2024-09-19T05:40:24.745710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958110+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:38:28.958110+0000","last_peered":"2024-09-19T05:38:28.958110+0000","last_clean":"2024-09-19T05:38:28.958110+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:38:28.958110+0000","last_undegraded":"2024-09-19T05:38:28.958110+0000","last_fullsized":"2024-09-19T05:38:28.958110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963683+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:38:25.963683+0000","last_peered":"2024-09-19T05:38:25.963683+0000","last_clean":"2024-09-19T05:38:25.963683+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:38:25.963683+0000","last_undegraded":"2024-09-19T05:38:25.963683+0000","last_fullsized":"2024-09-19T05:38:25.963683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:11.377100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.742108+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:40:24.742108+0000","last_peered":"2024-09-19T05:40:24.742108+0000","last_clean":"2024-09-19T05:40:24.742108+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:40:24.742108+0000","last_undegraded":"2024-09-19T05:40:24.742108+0000","last_fullsized":"2024-09-19T05:40:24.742108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:12.678183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'10","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:50.206587+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:39:50.206587+0000","last_peered":"2024-09-19T05:39:50.206587+0000","last_clean":"2024-09-19T05:39:50.206587+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:39:50.206587+0000","last_undegraded":"2024-09-19T05:39:50.206587+0000","last_fullsized":"2024-09-19T05:39:50.206587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:38.566395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963800+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:38:25.963800+0000","last_peered":"2024-09-19T05:38:25.963800+0000","last_clean":"2024-09-19T05:38:25.963800+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:38:25.963800+0000","last_undegraded":"2024-09-19T05:38:25.963800+0000","last_fullsized":"2024-09-19T05:38:25.963800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:16.289108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745854+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:40:24.745854+0000","last_peered":"2024-09-19T05:40:24.745854+0000","last_clean":"2024-09-19T05:40:24.745854+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:40:24.745854+0000","last_undegraded":"2024-09-19T05:40:24.745854+0000","last_fullsized":"2024-09-19T05:40:24.745854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.969791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.953555+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:38:28.953555+0000","last_peered":"2024-09-19T05:38:28.953555+0000","last_clean":"2024-09-19T05:38:28.953555+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:38:28.953555+0000","last_undegraded":"2024-09-19T05:38:28.953555+0000","last_fullsized":"2024-09-19T05:38:28.953555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695310+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:38:26.695310+0000","last_peered":"2024-09-19T05:38:26.695310+0000","last_clean":"2024-09-19T05:38:26.695310+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:38:26.695310+0000","last_undegraded":"2024-09-19T05:38:26.695310+0000","last_fullsized":"2024-09-19T05:38:26.695310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:33.270680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763014+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:40:24.763014+0000","last_peered":"2024-09-19T05:40:24.763014+0000","last_clean":"2024-09-19T05:40:24.763014+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:40:24.763014+0000","last_undegraded":"2024-09-19T05:40:24.763014+0000","last_fullsized":"2024-09-19T05:40:24.763014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954148+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:28.954148+0000","last_peered":"2024-09-19T05:38:28.954148+0000","last_clean":"2024-09-19T05:38:28.954148+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:28.954148+0000","last_undegraded":"2024-09-19T05:38:28.954148+0000","last_fullsized":"2024-09-19T05:38:28.954148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668707+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:38:26.668707+0000","last_peered":"2024-09-19T05:38:26.668707+0000","last_clean":"2024-09-19T05:38:26.668707+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:38:26.668707+0000","last_undegraded":"2024-09-19T05:38:26.668707+0000","last_fullsized":"2024-09-19T05:38:26.668707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963638+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:38:25.963638+0000","last_peered":"2024-09-19T05:38:25.963638+0000","last_clean":"2024-09-19T05:38:25.963638+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:38:25.963638+0000","last_undegraded":"2024-09-19T05:38:25.963638+0000","last_fullsized":"2024-09-19T05:38:25.963638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759101+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:40:24.759101+0000","last_peered":"2024-09-19T05:40:24.759101+0000","last_clean":"2024-09-19T05:40:24.759101+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:40:24.759101+0000","last_undegraded":"2024-09-19T05:40:24.759101+0000","last_fullsized":"2024-09-19T05:40:24.759101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.207954+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:40:00.207954+0000","last_peered":"2024-09-19T05:40:00.207954+0000","last_clean":"2024-09-19T05:40:00.207954+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:40:00.207954+0000","last_undegraded":"2024-09-19T05:40:00.207954+0000","last_fullsized":"2024-09-19T05:40:00.207954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:44.641094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697544+0000","last_change":"2024-09-19T05:38:26.696465+0000","last_active":"2024-09-19T05:38:26.697544+0000","last_peered":"2024-09-19T05:38:26.697544+0000","last_clean":"2024-09-19T05:38:26.697544+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:38:26.697544+0000","last_undegraded":"2024-09-19T05:38:26.697544+0000","last_fullsized":"2024-09-19T05:38:26.697544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:04.587288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757448+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:40:24.757448+0000","last_peered":"2024-09-19T05:40:24.757448+0000","last_clean":"2024-09-19T05:40:24.757448+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:40:24.757448+0000","last_undegraded":"2024-09-19T05:40:24.757448+0000","last_fullsized":"2024-09-19T05:40:24.757448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955324+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:38:28.955324+0000","last_peered":"2024-09-19T05:38:28.955324+0000","last_clean":"2024-09-19T05:38:28.955324+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:38:28.955324+0000","last_undegraded":"2024-09-19T05:38:28.955324+0000","last_fullsized":"2024-09-19T05:38:28.955324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:56.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695217+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:38:26.695217+0000","last_peered":"2024-09-19T05:38:26.695217+0000","last_clean":"2024-09-19T05:38:26.695217+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:38:26.695217+0000","last_undegraded":"2024-09-19T05:38:26.695217+0000","last_fullsized":"2024-09-19T05:38:26.695217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.760116+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:40:24.760116+0000","last_peered":"2024-09-19T05:40:24.760116+0000","last_clean":"2024-09-19T05:40:24.760116+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:40:24.760116+0000","last_undegraded":"2024-09-19T05:40:24.760116+0000","last_fullsized":"2024-09-19T05:40:24.760116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.951796+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:38:28.951796+0000","last_peered":"2024-09-19T05:38:28.951796+0000","last_clean":"2024-09-19T05:38:28.951796+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:38:28.951796+0000","last_undegraded":"2024-09-19T05:38:28.951796+0000","last_fullsized":"2024-09-19T05:38:28.951796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:13.410991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362359+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:38:26.362359+0000","last_peered":"2024-09-19T05:38:26.362359+0000","last_clean":"2024-09-19T05:38:26.362359+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:38:26.362359+0000","last_undegraded":"2024-09-19T05:38:26.362359+0000","last_fullsized":"2024-09-19T05:38:26.362359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758516+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:40:24.758516+0000","last_peered":"2024-09-19T05:40:24.758516+0000","last_clean":"2024-09-19T05:40:24.758516+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:40:24.758516+0000","last_undegraded":"2024-09-19T05:40:24.758516+0000","last_fullsized":"2024-09-19T05:40:24.758516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964847+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:38:25.964847+0000","last_peered":"2024-09-19T05:38:25.964847+0000","last_clean":"2024-09-19T05:38:25.964847+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:38:25.964847+0000","last_undegraded":"2024-09-19T05:38:25.964847+0000","last_fullsized":"2024-09-19T05:38:25.964847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964045+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:38:25.964045+0000","last_peered":"2024-09-19T05:38:25.964045+0000","last_clean":"2024-09-19T05:38:25.964045+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:38:25.964045+0000","last_undegraded":"2024-09-19T05:38:25.964045+0000","last_fullsized":"2024-09-19T05:38:25.964045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759461+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:40:24.759461+0000","last_peered":"2024-09-19T05:40:24.759461+0000","last_clean":"2024-09-19T05:40:24.759461+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:40:24.759461+0000","last_undegraded":"2024-09-19T05:40:24.759461+0000","last_fullsized":"2024-09-19T05:40:24.759461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'18","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.882182+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:39:45.882182+0000","last_peered":"2024-09-19T05:39:45.882182+0000","last_clean":"2024-09-19T05:39:45.882182+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:39:45.882182+0000","last_undegraded":"2024-09-19T05:39:45.882182+0000","last_fullsized":"2024-09-19T05:39:45.882182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:32.657786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695282+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:38:26.695282+0000","last_peered":"2024-09-19T05:38:26.695282+0000","last_clean":"2024-09-19T05:38:26.695282+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:38:26.695282+0000","last_undegraded":"2024-09-19T05:38:26.695282+0000","last_fullsized":"2024-09-19T05:38:26.695282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:59.872242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746363+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:40:24.746363+0000","last_peered":"2024-09-19T05:40:24.746363+0000","last_clean":"2024-09-19T05:40:24.746363+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:40:24.746363+0000","last_undegraded":"2024-09-19T05:40:24.746363+0000","last_fullsized":"2024-09-19T05:40:24.746363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:02.210594+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:40:02.210594+0000","last_peered":"2024-09-19T05:40:02.210594+0000","last_clean":"2024-09-19T05:40:02.210594+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:40:02.210594+0000","last_undegraded":"2024-09-19T05:40:02.210594+0000","last_fullsized":"2024-09-19T05:40:02.210594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966334+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:38:25.966334+0000","last_peered":"2024-09-19T05:38:25.966334+0000","last_clean":"2024-09-19T05:38:25.966334+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:38:25.966334+0000","last_undegraded":"2024-09-19T05:38:25.966334+0000","last_fullsized":"2024-09-19T05:38:25.966334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759895+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:40:24.759895+0000","last_peered":"2024-09-19T05:40:24.759895+0000","last_clean":"2024-09-19T05:40:24.759895+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:40:24.759895+0000","last_undegraded":"2024-09-19T05:40:24.759895+0000","last_fullsized":"2024-09-19T05:40:24.759895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888493+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:39:40.888493+0000","last_peered":"2024-09-19T05:39:40.888493+0000","last_clean":"2024-09-19T05:39:40.888493+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:39:40.888493+0000","last_undegraded":"2024-09-19T05:39:40.888493+0000","last_fullsized":"2024-09-19T05:39:40.888493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965580+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:38:25.965580+0000","last_peered":"2024-09-19T05:38:25.965580+0000","last_clean":"2024-09-19T05:38:25.965580+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:38:25.965580+0000","last_undegraded":"2024-09-19T05:38:25.965580+0000","last_fullsized":"2024-09-19T05:38:25.965580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763100+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:40:24.763100+0000","last_peered":"2024-09-19T05:40:24.763100+0000","last_clean":"2024-09-19T05:40:24.763100+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:40:24.763100+0000","last_undegraded":"2024-09-19T05:40:24.763100+0000","last_fullsized":"2024-09-19T05:40:24.763100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:05.602925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955469+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:38:28.955469+0000","last_peered":"2024-09-19T05:38:28.955469+0000","last_clean":"2024-09-19T05:38:28.955469+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:38:28.955469+0000","last_undegraded":"2024-09-19T05:38:28.955469+0000","last_fullsized":"2024-09-19T05:38:28.955469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:22.068444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363151+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:38:26.363151+0000","last_peered":"2024-09-19T05:38:26.363151+0000","last_clean":"2024-09-19T05:38:26.363151+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:38:26.363151+0000","last_undegraded":"2024-09-19T05:38:26.363151+0000","last_fullsized":"2024-09-19T05:38:26.363151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753826+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:40:24.753826+0000","last_peered":"2024-09-19T05:40:24.753826+0000","last_clean":"2024-09-19T05:40:24.753826+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:40:24.753826+0000","last_undegraded":"2024-09-19T05:40:24.753826+0000","last_fullsized":"2024-09-19T05:40:24.753826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'33","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.714069+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:40:24.714069+0000","last_peered":"2024-09-19T05:40:24.714069+0000","last_clean":"2024-09-19T05:40:24.714069+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:40:24.714069+0000","last_undegraded":"2024-09-19T05:40:24.714069+0000","last_fullsized":"2024-09-19T05:40:24.714069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888198+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:39:40.888198+0000","last_peered":"2024-09-19T05:39:40.888198+0000","last_clean":"2024-09-19T05:39:40.888198+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:39:40.888198+0000","last_undegraded":"2024-09-19T05:39:40.888198+0000","last_fullsized":"2024-09-19T05:39:40.888198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:07.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762696+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:40:24.762696+0000","last_peered":"2024-09-19T05:40:24.762696+0000","last_clean":"2024-09-19T05:40:24.762696+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:40:24.762696+0000","last_undegraded":"2024-09-19T05:40:24.762696+0000","last_fullsized":"2024-09-19T05:40:24.762696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:45.883954+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:39:45.883954+0000","last_peered":"2024-09-19T05:39:45.883954+0000","last_clean":"2024-09-19T05:39:45.883954+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:39:45.883954+0000","last_undegraded":"2024-09-19T05:39:45.883954+0000","last_fullsized":"2024-09-19T05:39:45.883954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:15.579122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964401+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:38:25.964401+0000","last_peered":"2024-09-19T05:38:25.964401+0000","last_clean":"2024-09-19T05:38:25.964401+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:38:25.964401+0000","last_undegraded":"2024-09-19T05:38:25.964401+0000","last_fullsized":"2024-09-19T05:38:25.964401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758824+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:40:24.758824+0000","last_peered":"2024-09-19T05:40:24.758824+0000","last_clean":"2024-09-19T05:40:24.758824+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:40:24.758824+0000","last_undegraded":"2024-09-19T05:40:24.758824+0000","last_fullsized":"2024-09-19T05:40:24.758824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:51.428724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955439+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:28.955439+0000","last_peered":"2024-09-19T05:38:28.955439+0000","last_clean":"2024-09-19T05:38:28.955439+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:28.955439+0000","last_undegraded":"2024-09-19T05:38:28.955439+0000","last_fullsized":"2024-09-19T05:38:28.955439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965127+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:38:25.965127+0000","last_peered":"2024-09-19T05:38:25.965127+0000","last_clean":"2024-09-19T05:38:25.965127+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:38:25.965127+0000","last_undegraded":"2024-09-19T05:38:25.965127+0000","last_fullsized":"2024-09-19T05:38:25.965127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751579+0000","last_change":"2024-09-19T05:38:26.669788+0000","last_active":"2024-09-19T05:40:24.751579+0000","last_peered":"2024-09-19T05:40:24.751579+0000","last_clean":"2024-09-19T05:40:24.751579+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:40:24.751579+0000","last_undegraded":"2024-09-19T05:40:24.751579+0000","last_fullsized":"2024-09-19T05:40:24.751579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.207435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.712502+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:40:24.712502+0000","last_peered":"2024-09-19T05:40:24.712502+0000","last_clean":"2024-09-19T05:40:24.712502+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:40:24.712502+0000","last_undegraded":"2024-09-19T05:40:24.712502+0000","last_fullsized":"2024-09-19T05:40:24.712502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965500+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:38:25.965500+0000","last_peered":"2024-09-19T05:38:25.965500+0000","last_clean":"2024-09-19T05:38:25.965500+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:38:25.965500+0000","last_undegraded":"2024-09-19T05:38:25.965500+0000","last_fullsized":"2024-09-19T05:38:25.965500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.695207+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:38:26.695207+0000","last_peered":"2024-09-19T05:38:26.695207+0000","last_clean":"2024-09-19T05:38:26.695207+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:38:26.695207+0000","last_undegraded":"2024-09-19T05:38:26.695207+0000","last_fullsized":"2024-09-19T05:38:26.695207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:20.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750837+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:40:24.750837+0000","last_peered":"2024-09-19T05:40:24.750837+0000","last_clean":"2024-09-19T05:40:24.750837+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:40:24.750837+0000","last_undegraded":"2024-09-19T05:40:24.750837+0000","last_fullsized":"2024-09-19T05:40:24.750837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:34.809504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958056+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:38:28.958056+0000","last_peered":"2024-09-19T05:38:28.958056+0000","last_clean":"2024-09-19T05:38:28.958056+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:38:28.958056+0000","last_undegraded":"2024-09-19T05:38:28.958056+0000","last_fullsized":"2024-09-19T05:38:28.958056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697541+0000","last_change":"2024-09-19T05:38:26.696467+0000","last_active":"2024-09-19T05:38:26.697541+0000","last_peered":"2024-09-19T05:38:26.697541+0000","last_clean":"2024-09-19T05:38:26.697541+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:38:26.697541+0000","last_undegraded":"2024-09-19T05:38:26.697541+0000","last_fullsized":"2024-09-19T05:38:26.697541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:43.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750330+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:40:24.750330+0000","last_peered":"2024-09-19T05:40:24.750330+0000","last_clean":"2024-09-19T05:40:24.750330+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:40:24.750330+0000","last_undegraded":"2024-09-19T05:40:24.750330+0000","last_fullsized":"2024-09-19T05:40:24.750330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955735+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:38:28.955735+0000","last_peered":"2024-09-19T05:38:28.955735+0000","last_clean":"2024-09-19T05:38:28.955735+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:38:28.955735+0000","last_undegraded":"2024-09-19T05:38:28.955735+0000","last_fullsized":"2024-09-19T05:38:28.955735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965075+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:38:25.965075+0000","last_peered":"2024-09-19T05:38:25.965075+0000","last_clean":"2024-09-19T05:38:25.965075+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:38:25.965075+0000","last_undegraded":"2024-09-19T05:38:25.965075+0000","last_fullsized":"2024-09-19T05:38:25.965075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751479+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:40:24.751479+0000","last_peered":"2024-09-19T05:40:24.751479+0000","last_clean":"2024-09-19T05:40:24.751479+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:40:24.751479+0000","last_undegraded":"2024-09-19T05:40:24.751479+0000","last_fullsized":"2024-09-19T05:40:24.751479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:30.369576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965122+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:38:25.965122+0000","last_peered":"2024-09-19T05:38:25.965122+0000","last_clean":"2024-09-19T05:38:25.965122+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:38:25.965122+0000","last_undegraded":"2024-09-19T05:38:25.965122+0000","last_fullsized":"2024-09-19T05:38:25.965122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:41.029291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:12.207200+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:40:12.207200+0000","last_peered":"2024-09-19T05:40:12.207200+0000","last_clean":"2024-09-19T05:40:12.207200+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:40:12.207200+0000","last_undegraded":"2024-09-19T05:40:12.207200+0000","last_fullsized":"2024-09-19T05:40:12.207200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1206,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.738115+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:40:24.738115+0000","last_peered":"2024-09-19T05:40:24.738115+0000","last_clean":"2024-09-19T05:40:24.738115+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:40:24.738115+0000","last_undegraded":"2024-09-19T05:40:24.738115+0000","last_fullsized":"2024-09-19T05:40:24.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965158+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:38:25.965158+0000","last_peered":"2024-09-19T05:38:25.965158+0000","last_clean":"2024-09-19T05:38:25.965158+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:38:25.965158+0000","last_undegraded":"2024-09-19T05:38:25.965158+0000","last_fullsized":"2024-09-19T05:38:25.965158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750202+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:40:24.750202+0000","last_peered":"2024-09-19T05:40:24.750202+0000","last_clean":"2024-09-19T05:40:24.750202+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:40:24.750202+0000","last_undegraded":"2024-09-19T05:40:24.750202+0000","last_fullsized":"2024-09-19T05:40:24.750202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.737426+0000","last_change":"2024-09-19T05:38:25.967860+0000","last_active":"2024-09-19T05:40:24.737426+0000","last_peered":"2024-09-19T05:40:24.737426+0000","last_clean":"2024-09-19T05:40:24.737426+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:40:24.737426+0000","last_undegraded":"2024-09-19T05:40:24.737426+0000","last_fullsized":"2024-09-19T05:40:24.737426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:04.609599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757981+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:40:24.757981+0000","last_peered":"2024-09-19T05:40:24.757981+0000","last_clean":"2024-09-19T05:40:24.757981+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:40:24.757981+0000","last_undegraded":"2024-09-19T05:40:24.757981+0000","last_fullsized":"2024-09-19T05:40:24.757981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750483+0000","last_change":"2024-09-19T05:37:43.795709+0000","last_active":"2024-09-19T05:40:24.750483+0000","last_peered":"2024-09-19T05:40:24.750483+0000","last_clean":"2024-09-19T05:40:24.750483+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:40:24.750483+0000","last_undegraded":"2024-09-19T05:40:24.750483+0000","last_fullsized":"2024-09-19T05:40:24.750483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:16.311920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744916+0000","last_change":"2024-09-19T05:38:25.967776+0000","last_active":"2024-09-19T05:40:24.744916+0000","last_peered":"2024-09-19T05:40:24.744916+0000","last_clean":"2024-09-19T05:40:24.744916+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:40:24.744916+0000","last_undegraded":"2024-09-19T05:40:24.744916+0000","last_fullsized":"2024-09-19T05:40:24.744916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:43.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746119+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:40:24.746119+0000","last_peered":"2024-09-19T05:40:24.746119+0000","last_clean":"2024-09-19T05:40:24.746119+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:40:24.746119+0000","last_undegraded":"2024-09-19T05:40:24.746119+0000","last_fullsized":"2024-09-19T05:40:24.746119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:44.761328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753563+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:40:24.753563+0000","last_peered":"2024-09-19T05:40:24.753563+0000","last_clean":"2024-09-19T05:40:24.753563+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:40:24.753563+0000","last_undegraded":"2024-09-19T05:40:24.753563+0000","last_fullsized":"2024-09-19T05:40:24.753563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748932+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:40:24.748932+0000","last_peered":"2024-09-19T05:40:24.748932+0000","last_clean":"2024-09-19T05:40:24.748932+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:40:24.748932+0000","last_undegraded":"2024-09-19T05:40:24.748932+0000","last_fullsized":"2024-09-19T05:40:24.748932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758003+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:40:24.758003+0000","last_peered":"2024-09-19T05:40:24.758003+0000","last_clean":"2024-09-19T05:40:24.758003+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:40:24.758003+0000","last_undegraded":"2024-09-19T05:40:24.758003+0000","last_fullsized":"2024-09-19T05:40:24.758003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751615+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:40:24.751615+0000","last_peered":"2024-09-19T05:40:24.751615+0000","last_clean":"2024-09-19T05:40:24.751615+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:40:24.751615+0000","last_undegraded":"2024-09-19T05:40:24.751615+0000","last_fullsized":"2024-09-19T05:40:24.751615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759252+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:40:24.759252+0000","last_peered":"2024-09-19T05:40:24.759252+0000","last_clean":"2024-09-19T05:40:24.759252+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:40:24.759252+0000","last_undegraded":"2024-09-19T05:40:24.759252+0000","last_fullsized":"2024-09-19T05:40:24.759252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763428+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:40:24.763428+0000","last_peered":"2024-09-19T05:40:24.763428+0000","last_clean":"2024-09-19T05:40:24.763428+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:40:24.763428+0000","last_undegraded":"2024-09-19T05:40:24.763428+0000","last_fullsized":"2024-09-19T05:40:24.763428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:12.375545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.749502+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:40:24.749502+0000","last_peered":"2024-09-19T05:40:24.749502+0000","last_clean":"2024-09-19T05:40:24.749502+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:40:24.749502+0000","last_undegraded":"2024-09-19T05:40:24.749502+0000","last_fullsized":"2024-09-19T05:40:24.749502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751376+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:40:24.751376+0000","last_peered":"2024-09-19T05:40:24.751376+0000","last_clean":"2024-09-19T05:40:24.751376+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:40:24.751376+0000","last_undegraded":"2024-09-19T05:40:24.751376+0000","last_fullsized":"2024-09-19T05:40:24.751376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.733287+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:40:24.733287+0000","last_peered":"2024-09-19T05:40:24.733287+0000","last_clean":"2024-09-19T05:40:24.733287+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:40:24.733287+0000","last_undegraded":"2024-09-19T05:40:24.733287+0000","last_fullsized":"2024-09-19T05:40:24.733287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:09.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757641+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:40:24.757641+0000","last_peered":"2024-09-19T05:40:24.757641+0000","last_clean":"2024-09-19T05:40:24.757641+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:40:24.757641+0000","last_undegraded":"2024-09-19T05:40:24.757641+0000","last_fullsized":"2024-09-19T05:40:24.757641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757694+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:40:24.757694+0000","last_peered":"2024-09-19T05:40:24.757694+0000","last_clean":"2024-09-19T05:40:24.757694+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:40:24.757694+0000","last_undegraded":"2024-09-19T05:40:24.757694+0000","last_fullsized":"2024-09-19T05:40:24.757694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747123+0000","last_change":"2024-09-19T05:37:43.787746+0000","last_active":"2024-09-19T05:40:24.747123+0000","last_peered":"2024-09-19T05:40:24.747123+0000","last_clean":"2024-09-19T05:40:24.747123+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:40:24.747123+0000","last_undegraded":"2024-09-19T05:40:24.747123+0000","last_fullsized":"2024-09-19T05:40:24.747123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:09.191792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747557+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:40:24.747557+0000","last_peered":"2024-09-19T05:40:24.747557+0000","last_clean":"2024-09-19T05:40:24.747557+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:40:24.747557+0000","last_undegraded":"2024-09-19T05:40:24.747557+0000","last_fullsized":"2024-09-19T05:40:24.747557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:33.036528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754142+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:40:24.754142+0000","last_peered":"2024-09-19T05:40:24.754142+0000","last_clean":"2024-09-19T05:40:24.754142+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:40:24.754142+0000","last_undegraded":"2024-09-19T05:40:24.754142+0000","last_fullsized":"2024-09-19T05:40:24.754142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.740195+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:40:24.740195+0000","last_peered":"2024-09-19T05:40:24.740195+0000","last_clean":"2024-09-19T05:40:24.740195+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:40:24.740195+0000","last_undegraded":"2024-09-19T05:40:24.740195+0000","last_fullsized":"2024-09-19T05:40:24.740195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745746+0000","last_change":"2024-09-19T05:38:25.968706+0000","last_active":"2024-09-19T05:40:24.745746+0000","last_peered":"2024-09-19T05:40:24.745746+0000","last_clean":"2024-09-19T05:40:24.745746+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:40:24.745746+0000","last_undegraded":"2024-09-19T05:40:24.745746+0000","last_fullsized":"2024-09-19T05:40:24.745746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:52.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758868+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:40:24.758868+0000","last_peered":"2024-09-19T05:40:24.758868+0000","last_clean":"2024-09-19T05:40:24.758868+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:40:24.758868+0000","last_undegraded":"2024-09-19T05:40:24.758868+0000","last_fullsized":"2024-09-19T05:40:24.758868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758530+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:40:24.758530+0000","last_peered":"2024-09-19T05:40:24.758530+0000","last_clean":"2024-09-19T05:40:24.758530+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:40:24.758530+0000","last_undegraded":"2024-09-19T05:40:24.758530+0000","last_fullsized":"2024-09-19T05:40:24.758530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762985+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:40:24.762985+0000","last_peered":"2024-09-19T05:40:24.762985+0000","last_clean":"2024-09-19T05:40:24.762985+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:40:24.762985+0000","last_undegraded":"2024-09-19T05:40:24.762985+0000","last_fullsized":"2024-09-19T05:40:24.762985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.756104+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:40:24.756104+0000","last_peered":"2024-09-19T05:40:24.756104+0000","last_clean":"2024-09-19T05:40:24.756104+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:40:24.756104+0000","last_undegraded":"2024-09-19T05:40:24.756104+0000","last_fullsized":"2024-09-19T05:40:24.756104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759188+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:40:24.759188+0000","last_peered":"2024-09-19T05:40:24.759188+0000","last_clean":"2024-09-19T05:40:24.759188+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:40:24.759188+0000","last_undegraded":"2024-09-19T05:40:24.759188+0000","last_fullsized":"2024-09-19T05:40:24.759188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745715+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:40:24.745715+0000","last_peered":"2024-09-19T05:40:24.745715+0000","last_clean":"2024-09-19T05:40:24.745715+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:40:24.745715+0000","last_undegraded":"2024-09-19T05:40:24.745715+0000","last_fullsized":"2024-09-19T05:40:24.745715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758744+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:40:24.758744+0000","last_peered":"2024-09-19T05:40:24.758744+0000","last_clean":"2024-09-19T05:40:24.758744+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:40:24.758744+0000","last_undegraded":"2024-09-19T05:40:24.758744+0000","last_fullsized":"2024-09-19T05:40:24.758744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748250+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:40:24.748250+0000","last_peered":"2024-09-19T05:40:24.748250+0000","last_clean":"2024-09-19T05:40:24.748250+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:40:24.748250+0000","last_undegraded":"2024-09-19T05:40:24.748250+0000","last_fullsized":"2024-09-19T05:40:24.748250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:59.977469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746682+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:40:24.746682+0000","last_peered":"2024-09-19T05:40:24.746682+0000","last_clean":"2024-09-19T05:40:24.746682+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:40:24.746682+0000","last_undegraded":"2024-09-19T05:40:24.746682+0000","last_fullsized":"2024-09-19T05:40:24.746682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:18.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754945+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:40:24.754945+0000","last_peered":"2024-09-19T05:40:24.754945+0000","last_clean":"2024-09-19T05:40:24.754945+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:40:24.754945+0000","last_undegraded":"2024-09-19T05:40:24.754945+0000","last_fullsized":"2024-09-19T05:40:24.754945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49294,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":264,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":98588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718685,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":167715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":168161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":128091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":42528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:32.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:40:32.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.189+0000 7f78c9a27640 1 Processor -- start 2024-09-19T05:40:32.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.189+0000 7f78c9a27640 1 -- start start 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c9a27640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c9a27640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f78c40c5950 0x7f78c40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c9a27640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c40cbed0 con 0x7f78c4155040 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c9a27640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f78c415bd70 con 0x7f78c40c5950 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c9a27640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f78c40cbbf0 con 0x7f78c40b3540 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78ba7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c37fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f78c40c5950 0x7f78c40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c2ffd640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f78c4155040 0x7f78c415e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:35560/0 (socket says 172.21.15.103:35560) 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.190+0000 7f78c2ffd640 1 -- 172.21.15.103:0/655292744 learned_addr learned my addr 172.21.15.103:0/655292744 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.191+0000 7f78c37fe640 1 -- 172.21.15.103:0/655292744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 msgr2=0x7f78c40cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.191+0000 7f78c37fe640 1 --2- 172.21.15.103:0/655292744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c40cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.191+0000 7f78c37fe640 1 -- 172.21.15.103:0/655292744 >> v1:172.21.15.174:6789/0 conn(0x7f78c4155040 legacy=0x7f78c415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.191+0000 7f78c37fe640 1 -- 172.21.15.103:0/655292744 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c415afb0 con 0x7f78c40c5950 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.191+0000 7f78c37fe640 1 --2- 172.21.15.103:0/655292744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 0x7f78c40cc2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009d90 tx=0x7f78bc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd95904796140098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.191+0000 7f78c27fc640 1 -- 172.21.15.103:0/655292744 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc007740 con 0x7f78c40c5950 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c27fc640 1 -- 172.21.15.103:0/655292744 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78bc0078e0 con 0x7f78c40c5950 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c27fc640 1 -- 172.21.15.103:0/655292744 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc007cb0 con 0x7f78c40c5950 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 -- 172.21.15.103:0/655292744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 msgr2=0x7f78c40cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 --2- 172.21.15.103:0/655292744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 0x7f78c40cc2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009d90 tx=0x7f78bc02a6f0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 -- 172.21.15.103:0/655292744 shutdown_connections 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 --2- 172.21.15.103:0/655292744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 0x7f78c40cc2c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 --2- 172.21.15.103:0/655292744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c40cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 -- 172.21.15.103:0/655292744 >> 172.21.15.103:0/655292744 conn(0x7f78c4073340 msgr2=0x7f78c4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 -- 172.21.15.103:0/655292744 shutdown_connections 2024-09-19T05:40:32.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.192+0000 7f78c9a27640 1 -- 172.21.15.103:0/655292744 wait complete. 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.193+0000 7f78c9a27640 1 Processor -- start 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.193+0000 7f78c9a27640 1 -- start start 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c9a27640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c41505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c9a27640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 0x7f78c414b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c9a27640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4155040 0x7f78c414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c9a27640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78c415b850 con 0x7f78c4155040 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c9a27640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78c415b570 con 0x7f78c40c5950 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c9a27640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f78c415eb30 con 0x7f78c40b3540 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4155040 0x7f78c414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4155040 0x7f78c414b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39584/0 (socket says 172.21.15.103:39584) 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c37fe640 1 -- 172.21.15.103:0/347332995 learned_addr learned my addr 172.21.15.103:0/347332995 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78ba7fc640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 0x7f78c414b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:32.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.194+0000 7f78c2ffd640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c41505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c37fe640 1 -- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 msgr2=0x7f78c41505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c37fe640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c41505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c37fe640 1 -- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 msgr2=0x7f78c414b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c37fe640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 0x7f78c414b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c37fe640 1 -- 172.21.15.103:0/347332995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c4159990 con 0x7f78c4155040 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c37fe640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4155040 0x7f78c414b950 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f78bc02ace0 tx=0x7f78bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c0ff9640 1 -- 172.21.15.103:0/347332995 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc041030 con 0x7f78c4155040 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c0ff9640 1 -- 172.21.15.103:0/347332995 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78bc031a40 con 0x7f78c4155040 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c41f5030 con 0x7f78c4155040 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c0ff9640 1 -- 172.21.15.103:0/347332995 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc009450 con 0x7f78c4155040 2024-09-19T05:40:32.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.195+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c4159f30 con 0x7f78c4155040 2024-09-19T05:40:32.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.196+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c40cb540 con 0x7f78c4155040 2024-09-19T05:40:32.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.196+0000 7f78c0ff9640 1 -- 172.21.15.103:0/347332995 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f78bc039040 con 0x7f78c4155040 2024-09-19T05:40:32.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.197+0000 7f78c0ff9640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78a406c2e0 0x7f78a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:32.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.197+0000 7f78c0ff9640 1 -- 172.21.15.103:0/347332995 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f78bc0ac690 con 0x7f78c4155040 2024-09-19T05:40:32.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.197+0000 7f78c2ffd640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78a406c2e0 0x7f78a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:32.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.197+0000 7f78c2ffd640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78a406c2e0 0x7f78a406e7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007fd0 tx=0x7f78b4007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:32.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.201+0000 7f78c0ff9640 1 -- 172.21.15.103:0/347332995 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f78bc07a320 con 0x7f78c4155040 2024-09-19T05:40:32.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.368+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78c4069380 con 0x7f78c4155040 2024-09-19T05:40:32.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.369+0000 7f78c0ff9640 1 -- 172.21.15.103:0/347332995 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+19059 (secure 0 0 0) 0x7f78bc07e620 con 0x7f78c4155040 2024-09-19T05:40:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:40:32.372 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:38:25.956806+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:40:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.371+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78a406c2e0 msgr2=0x7f78a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.371+0000 7f78c9a27640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78a406c2e0 0x7f78a406e7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007fd0 tx=0x7f78b4007e80 comp rx=0 tx=0).stop 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.371+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4155040 msgr2=0x7f78c414b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.371+0000 7f78c9a27640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4155040 0x7f78c414b950 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f78bc02ace0 tx=0x7f78bc004a40 comp rx=0 tx=0).stop 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 shutdown_connections 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f78a406c2e0 0x7f78a406e7a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c4155040 0x7f78c414b950 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78c40c5950 0x7f78c414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 --2- 172.21.15.103:0/347332995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78c40b3540 0x7f78c41505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 >> 172.21.15.103:0/347332995 conn(0x7f78c4073340 msgr2=0x7f78c406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 shutdown_connections 2024-09-19T05:40:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:32.372+0000 7f78c9a27640 1 -- 172.21.15.103:0/347332995 wait complete. 2024-09-19T05:40:33.389 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T05:40:33.389 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:33.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 Processor -- start 2024-09-19T05:40:33.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 -- start start 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa34c1443a0 0x7fa34c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa34c0c9780 0x7fa34c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0cdab0 0x7fa34c073450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa34c0c9fc0 con 0x7fa34c1443a0 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa34c0cdec0 con 0x7fa34c0c9780 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.495+0000 7fa3525be640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa34c072770 con 0x7fa34c0cdab0 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa34c1443a0 0x7fa34c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa34c1443a0 0x7fa34c15eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39590/0 (socket says 172.21.15.103:39590) 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 -- 172.21.15.103:0/2716659748 learned_addr learned my addr 172.21.15.103:0/2716659748 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34b7fe640 1 --2- 172.21.15.103:0/2716659748 >> v2:172.21.15.174:3300/0 conn(0x7fa34c0c9780 0x7fa34c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa350b5b640 1 --2- 172.21.15.103:0/2716659748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0cdab0 0x7fa34c073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 -- 172.21.15.103:0/2716659748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0cdab0 msgr2=0x7fa34c073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 --2- 172.21.15.103:0/2716659748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0cdab0 0x7fa34c073450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 -- 172.21.15.103:0/2716659748 >> v2:172.21.15.174:3300/0 conn(0x7fa34c0c9780 msgr2=0x7fa34c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 --2- 172.21.15.103:0/2716659748 >> v2:172.21.15.174:3300/0 conn(0x7fa34c0c9780 0x7fa34c0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa34bfff640 1 -- 172.21.15.103:0/2716659748 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c15b0b0 con 0x7fa34c1443a0 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.496+0000 7fa350b5b640 1 --2- 172.21.15.103:0/2716659748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0cdab0 0x7fa34c073450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa34bfff640 1 --2- 172.21.15.103:0/2716659748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c1443a0 0x7fa34c15eea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0729e0 tx=0x7fa33c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f069d211a5b8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa34affd640 1 -- 172.21.15.103:0/2716659748 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c037070 con 0x7fa34c1443a0 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa34affd640 1 -- 172.21.15.103:0/2716659748 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c032440 con 0x7fa34c1443a0 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa34affd640 1 -- 172.21.15.103:0/2716659748 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c032810 con 0x7fa34c1443a0 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 -- 172.21.15.103:0/2716659748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c1443a0 msgr2=0x7fa34c15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 --2- 172.21.15.103:0/2716659748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c1443a0 0x7fa34c15eea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0729e0 tx=0x7fa33c02a1e0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 -- 172.21.15.103:0/2716659748 shutdown_connections 2024-09-19T05:40:33.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 --2- 172.21.15.103:0/2716659748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0cdab0 0x7fa34c073450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 --2- 172.21.15.103:0/2716659748 >> v2:172.21.15.174:3300/0 conn(0x7fa34c0c9780 0x7fa34c0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 --2- 172.21.15.103:0/2716659748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c1443a0 0x7fa34c15eea0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 -- 172.21.15.103:0/2716659748 >> 172.21.15.103:0/2716659748 conn(0x7fa34c070030 msgr2=0x7fa34c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:33.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 -- 172.21.15.103:0/2716659748 shutdown_connections 2024-09-19T05:40:33.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.497+0000 7fa3525be640 1 -- 172.21.15.103:0/2716659748 wait complete. 2024-09-19T05:40:33.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.498+0000 7fa3525be640 1 Processor -- start 2024-09-19T05:40:33.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa3525be640 1 -- start start 2024-09-19T05:40:33.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa3525be640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0c9780 0x7fa34c13cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa3525be640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cdab0 0x7fa34c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa3525be640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa34c1443a0 0x7fa34c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa3525be640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c15b630 con 0x7fa34c0cdab0 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa3525be640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c15f3e0 con 0x7fa34c1443a0 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa3525be640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa34c15b910 con 0x7fa34c0c9780 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.499+0000 7fa34b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cdab0 0x7fa34c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cdab0 0x7fa34c154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39598/0 (socket says 172.21.15.103:39598) 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 -- 172.21.15.103:0/3491302796 learned_addr learned my addr 172.21.15.103:0/3491302796 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34bfff640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0c9780 0x7fa34c13cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa350b5b640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa34c1443a0 0x7fa34c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 -- 172.21.15.103:0/3491302796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0c9780 msgr2=0x7fa34c13cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa34c0c9780 0x7fa34c13cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 -- 172.21.15.103:0/3491302796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa34c1443a0 msgr2=0x7fa34c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa34c1443a0 0x7fa34c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 -- 172.21.15.103:0/3491302796 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c1e5190 con 0x7fa34c0cdab0 2024-09-19T05:40:33.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa34b7fe640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cdab0 0x7fa34c154ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d800 tx=0x7fa34000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340018030 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3400096a0 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34c1e5450 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340009870 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.500+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa34c1e60b0 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.501+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa34c0c8d20 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa34001b070 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa348ff9640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33806c2b0 0x7fa33806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa34008ba40 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa34bfff640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33806c2b0 0x7fa33806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa348ff9640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7fa338075cd0 0x7fa338078170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 --> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa340001d30 con 0x7fa338075cd0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa3400902c0 con 0x7fa34c0cdab0 2024-09-19T05:40:33.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa350b5b640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7fa338075cd0 0x7fa338078170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.502+0000 7fa34bfff640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33806c2b0 0x7fa33806e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa33c034000 tx=0x7fa33c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.503+0000 7fa350b5b640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7fa338075cd0 0x7fa338078170 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.503+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== osd.0 v2:172.21.15.103:6800/3619190800 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa340001d30 con 0x7fa338075cd0 2024-09-19T05:40:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 --> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa34c15bbf0 con 0x7fa338075cd0 2024-09-19T05:40:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa348ff9640 1 -- 172.21.15.103:0/3491302796 <== osd.0 v2:172.21.15.103:6800/3619190800 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa34c15bbf0 con 0x7fa338075cd0 2024-09-19T05:40:33.518 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:33.518 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:33.519 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7fa338075cd0 msgr2=0x7fa338078170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6800/3619190800,v1:172.21.15.103:6801/3619190800] conn(0x7fa338075cd0 0x7fa338078170 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33806c2b0 msgr2=0x7fa33806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa33806c2b0 0x7fa33806e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa33c034000 tx=0x7fa33c02e000 comp rx=0 tx=0).stop 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cdab0 msgr2=0x7fa34c154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 --2- 172.21.15.103:0/3491302796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cdab0 0x7fa34c154ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d800 tx=0x7fa34000dcc0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa350b5b640 1 -- 172.21.15.103:0/3491302796 reap_dead start 2024-09-19T05:40:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 shutdown_connections 2024-09-19T05:40:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 >> 172.21.15.103:0/3491302796 conn(0x7fa34c070030 msgr2=0x7fa34c15a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 shutdown_connections 2024-09-19T05:40:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.516+0000 7fa3525be640 1 -- 172.21.15.103:0/3491302796 wait complete. 2024-09-19T05:40:33.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T05:40:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.627+0000 7fd5ae92a640 1 Processor -- start 2024-09-19T05:40:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.627+0000 7fd5ae92a640 1 -- start start 2024-09-19T05:40:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5ae92a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a8152f00 0x7fd5a8073c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5ae92a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd5a8074180 0x7fd5a815c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5ae92a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a8074610 con 0x7fd5a815c780 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5ae92a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a80c8cc0 con 0x7fd5a8074180 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5ae92a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a80c7f00 con 0x7fd5a8152f00 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5a77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd5a8074180 0x7fd5a815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5a77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd5a8074180 0x7fd5a815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39602/0 (socket says 172.21.15.103:39602) 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.628+0000 7fd5a77fe640 1 -- 172.21.15.103:0/1890924491 learned_addr learned my addr 172.21.15.103:0/1890924491 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a7fff640 1 --2- 172.21.15.103:0/1890924491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a8152f00 0x7fd5a8073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a77fe640 1 -- 172.21.15.103:0/1890924491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a8152f00 msgr2=0x7fd5a8073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a77fe640 1 --2- 172.21.15.103:0/1890924491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a8152f00 0x7fd5a8073c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a77fe640 1 -- 172.21.15.103:0/1890924491 >> v1:172.21.15.103:6789/0 conn(0x7fd5a815c780 legacy=0x7fd5a80ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a77fe640 1 -- 172.21.15.103:0/1890924491 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a80c81e0 con 0x7fd5a8074180 2024-09-19T05:40:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a77fe640 1 --2- 172.21.15.103:0/1890924491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8074180 0x7fd5a815c240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009870 tx=0x7fd59c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6872cbe06f8483c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a6ffd640 1 -- 172.21.15.103:0/1890924491 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c037070 con 0x7fd5a8074180 2024-09-19T05:40:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a6ffd640 1 -- 172.21.15.103:0/1890924491 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c02ae50 con 0x7fd5a8074180 2024-09-19T05:40:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.629+0000 7fd5a6ffd640 1 -- 172.21.15.103:0/1890924491 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c032860 con 0x7fd5a8074180 2024-09-19T05:40:33.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1890924491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8074180 msgr2=0x7fd5a815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1890924491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8074180 0x7fd5a815c240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009870 tx=0x7fd59c02a300 comp rx=0 tx=0).stop 2024-09-19T05:40:33.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1890924491 shutdown_connections 2024-09-19T05:40:33.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1890924491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8074180 0x7fd5a815c240 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1890924491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a8152f00 0x7fd5a8073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1890924491 >> 172.21.15.103:0/1890924491 conn(0x7fd5a806c240 msgr2=0x7fd5a8067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:33.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1890924491 shutdown_connections 2024-09-19T05:40:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.630+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1890924491 wait complete. 2024-09-19T05:40:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.631+0000 7fd5ae92a640 1 Processor -- start 2024-09-19T05:40:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.631+0000 7fd5ae92a640 1 -- start start 2024-09-19T05:40:33.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5ae92a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8152f00 0x7fd5a80c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5ae92a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5a815c780 0x7fd5a8151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5ae92a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a806e890 0x7fd5a8152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5ae92a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a8073710 con 0x7fd5a8152f00 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5ae92a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a80c87a0 con 0x7fd5a815c780 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5ae92a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a81532e0 con 0x7fd5a806e890 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8152f00 0x7fd5a80c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8152f00 0x7fd5a80c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39618/0 (socket says 172.21.15.103:39618) 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a7fff640 1 -- 172.21.15.103:0/1481891917 learned_addr learned my addr 172.21.15.103:0/1481891917 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5acec7640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a806e890 0x7fd5a8152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a77fe640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5a815c780 0x7fd5a8151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a7fff640 1 -- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a806e890 msgr2=0x7fd5a8152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a7fff640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a806e890 0x7fd5a8152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a7fff640 1 -- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5a815c780 msgr2=0x7fd5a8151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.632+0000 7fd5a7fff640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5a815c780 0x7fd5a8151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.633+0000 7fd5a7fff640 1 -- 172.21.15.103:0/1481891917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a81f44c0 con 0x7fd5a8152f00 2024-09-19T05:40:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.633+0000 7fd5a7fff640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8152f00 0x7fd5a80c4cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c7f0 tx=0x7fd59800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.633+0000 7fd5a4ff9640 1 -- 172.21.15.103:0/1481891917 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598015070 con 0x7fd5a8152f00 2024-09-19T05:40:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.633+0000 7fd5a4ff9640 1 -- 172.21.15.103:0/1481891917 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd598004220 con 0x7fd5a8152f00 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.633+0000 7fd5a4ff9640 1 -- 172.21.15.103:0/1481891917 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598003610 con 0x7fd5a8152f00 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.633+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a81f47a0 con 0x7fd5a8152f00 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.633+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a81f4d60 con 0x7fd5a8152f00 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.634+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a8071820 con 0x7fd5a8152f00 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.634+0000 7fd5a4ff9640 1 -- 172.21.15.103:0/1481891917 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5980039c0 con 0x7fd5a8152f00 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.635+0000 7fd5a4ff9640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd59406c2e0 0x7fd59406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.635+0000 7fd5a4ff9640 1 -- 172.21.15.103:0/1481891917 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd59808b7a0 con 0x7fd5a8152f00 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.635+0000 7fd5a77fe640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd59406c2e0 0x7fd59406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.635+0000 7fd5a77fe640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd59406c2e0 0x7fd59406e7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd59c034000 tx=0x7fd59c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.639+0000 7fd5a4ff9640 1 -- 172.21.15.103:0/1481891917 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd598059ba0 con 0x7fd5a8152f00 2024-09-19T05:40:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.807+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd5a81f4260 con 0x7fd59406c2e0 2024-09-19T05:40:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.807+0000 7fd5a4ff9640 1 -- 172.21.15.103:0/1481891917 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd59c02ae50 con 0x7fd59406c2e0 2024-09-19T05:40:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T05:40:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd59406c2e0 msgr2=0x7fd59406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd59406c2e0 0x7fd59406e7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd59c034000 tx=0x7fd59c02e000 comp rx=0 tx=0).stop 2024-09-19T05:40:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8152f00 msgr2=0x7fd5a80c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8152f00 0x7fd5a80c4cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c7f0 tx=0x7fd59800ccb0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 shutdown_connections 2024-09-19T05:40:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd59406c2e0 0x7fd59406e7a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5a806e890 0x7fd5a8152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5a815c780 0x7fd5a8151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 --2- 172.21.15.103:0/1481891917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5a8152f00 0x7fd5a80c4cb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.809+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 >> 172.21.15.103:0/1481891917 conn(0x7fd5a806c240 msgr2=0x7fd5a8150720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.810+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 shutdown_connections 2024-09-19T05:40:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.810+0000 7fd5ae92a640 1 -- 172.21.15.103:0/1481891917 wait complete. 2024-09-19T05:40:33.823 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T05:40:33.823 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:33.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.923+0000 7f24d2a8d640 1 Processor -- start 2024-09-19T05:40:33.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.923+0000 7f24d2a8d640 1 -- start start 2024-09-19T05:40:33.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d2a8d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24cc1550f0 0x7f24cc15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d2a8d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 0x7f24cc06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d2a8d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24cc15e450 con 0x7f24cc0cb6b0 2024-09-19T05:40:33.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d2a8d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f24cc15f2b0 con 0x7f24cc1550f0 2024-09-19T05:40:33.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d2a8d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f24cc15e730 con 0x7f24cc0cb2b0 2024-09-19T05:40:33.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d102a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f24cc0cb6b0 0x7f24cc0cc240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35006/0 (socket says 172.21.15.103:35006) 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d102a640 1 -- 172.21.15.103:0/4039781790 learned_addr learned my addr 172.21.15.103:0/4039781790 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24d0829640 1 --2- 172.21.15.103:0/4039781790 >> v2:172.21.15.174:3300/0 conn(0x7f24cc1550f0 0x7f24cc15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c3fff640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 0x7f24cc06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757118960 0 0) 0x7f24cc15e450 con 0x7f24cc0cb6b0 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24b4003520 con 0x7f24cc0cb6b0 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3998060246 0 0) 0x7f24b4003520 con 0x7f24cc0cb6b0 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 msgr2=0x7f24cc06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 0x7f24cc06db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 >> v2:172.21.15.174:3300/0 conn(0x7f24cc1550f0 msgr2=0x7f24cc15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 --2- 172.21.15.103:0/4039781790 >> v2:172.21.15.174:3300/0 conn(0x7f24cc1550f0 0x7f24cc15b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc15ea10 con 0x7f24cc0cb6b0 2024-09-19T05:40:33.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f24c4001670 con 0x7f24cc0cb6b0 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 >> v1:172.21.15.103:6789/0 conn(0x7f24cc0cb6b0 legacy=0x7f24cc0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.924+0000 7f24c37fe640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b40039b0 0x7f24b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24c37fe640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 0x7f24b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24c37fe640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc15f2b0 con 0x7f24b4004d40 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc15e730 con 0x7f24b40039b0 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f24b400b9c0 con 0x7f24cc0cb2b0 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24d102a640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24d0829640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b40039b0 0x7f24b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24c3fff640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 0x7f24b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24d102a640 1 -- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 msgr2=0x7f24b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24d102a640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0cb2b0 0x7f24b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24d102a640 1 -- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b40039b0 msgr2=0x7f24b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:33.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24d102a640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b40039b0 0x7f24b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.925+0000 7f24d102a640 1 -- 172.21.15.103:0/4039781790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b4003520 con 0x7f24b4004d40 2024-09-19T05:40:33.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d102a640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24b40051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c240 tx=0x7f24b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd62837d67e0119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c402e070 con 0x7f24b4004d40 2024-09-19T05:40:33.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c4005af0 con 0x7f24b4004d40 2024-09-19T05:40:33.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24c37fe640 1 -- 172.21.15.103:0/4039781790 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4007d30 con 0x7f24b4004d40 2024-09-19T05:40:33.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d2a8d640 1 -- 172.21.15.103:0/4039781790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 msgr2=0x7f24b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d2a8d640 1 --2- 172.21.15.103:0/4039781790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24b40051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c240 tx=0x7f24b4005830 comp rx=0 tx=0).stop 2024-09-19T05:40:33.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d102a640 1 -- 172.21.15.103:0/4039781790 reap_dead start 2024-09-19T05:40:33.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d2a8d640 1 -- 172.21.15.103:0/4039781790 shutdown_connections 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d2a8d640 1 -- 172.21.15.103:0/4039781790 >> 172.21.15.103:0/4039781790 conn(0x7f24cc06bd10 msgr2=0x7f24cc06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d2a8d640 1 -- 172.21.15.103:0/4039781790 shutdown_connections 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.926+0000 7f24d2a8d640 1 -- 172.21.15.103:0/4039781790 wait complete. 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.927+0000 7f24d2a8d640 1 Processor -- start 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d2a8d640 1 -- start start 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d2a8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24cc0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d2a8d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24cc0c9a50 0x7f24cc15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d2a8d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0c7520 0x7f24cc0c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d2a8d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc1554d0 con 0x7f24b4004d40 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d2a8d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc15efd0 con 0x7f24cc0c9a50 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d2a8d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f24cc0cc950 con 0x7f24cc0c7520 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d0829640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24cc0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d0829640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24cc0c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39634/0 (socket says 172.21.15.103:39634) 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.928+0000 7f24d0829640 1 -- 172.21.15.103:0/2165000190 learned_addr learned my addr 172.21.15.103:0/2165000190 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d102a640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0c7520 0x7f24cc0c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24c3fff640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24cc0c9a50 0x7f24cc15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d0829640 1 -- 172.21.15.103:0/2165000190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0c7520 msgr2=0x7f24cc0c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d0829640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24cc0c7520 0x7f24cc0c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d0829640 1 -- 172.21.15.103:0/2165000190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24cc0c9a50 msgr2=0x7f24cc15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d0829640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24cc0c9a50 0x7f24cc15cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d0829640 1 -- 172.21.15.103:0/2165000190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc0c9150 con 0x7f24b4004d40 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d0829640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24cc0c9fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24c8011e60 tx=0x7f24c800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c8015630 con 0x7f24b4004d40 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80157d0 con 0x7f24b4004d40 2024-09-19T05:40:33.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24cc0c8be0 con 0x7f24b4004d40 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c8015ba0 con 0x7f24b4004d40 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.929+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24cc1f52e0 con 0x7f24b4004d40 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.930+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24cc0c94f0 con 0x7f24b4004d40 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.930+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f24c801d400 con 0x7f24b4004d40 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24c17fa640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f24b806c2e0 0x7f24b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f24c808c960 con 0x7f24b4004d40 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24c3fff640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f24b806c2e0 0x7f24b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24c17fa640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f24b8075cf0 0x7f24b8078190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 --> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24c8025ec0 con 0x7f24b8075cf0 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24c80912c0 con 0x7f24b4004d40 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24d102a640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f24b8075cf0 0x7f24b8078190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.931+0000 7f24c3fff640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f24b806c2e0 0x7f24b806e7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24cc14ef80 tx=0x7f24bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.932+0000 7f24d102a640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f24b8075cf0 0x7f24b8078190 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:33.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.932+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== osd.1 v2:172.21.15.103:6808/2116552185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24c8025ec0 con 0x7f24b8075cf0 2024-09-19T05:40:33.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.944+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 --> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f24cc15b8a0 con 0x7f24b8075cf0 2024-09-19T05:40:33.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24c17fa640 1 -- 172.21.15.103:0/2165000190 <== osd.1 v2:172.21.15.103:6808/2116552185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f24cc15b8a0 con 0x7f24b8075cf0 2024-09-19T05:40:33.947 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:33.947 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:33.947 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:33.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f24b8075cf0 msgr2=0x7f24b8078190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6808/2116552185,v1:172.21.15.103:6809/2116552185] conn(0x7f24b8075cf0 0x7f24b8078190 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f24b806c2e0 msgr2=0x7f24b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f24b806c2e0 0x7f24b806e7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24cc14ef80 tx=0x7f24bc008040 comp rx=0 tx=0).stop 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 msgr2=0x7f24cc0c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 --2- 172.21.15.103:0/2165000190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24b4004d40 0x7f24cc0c9fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24c8011e60 tx=0x7f24c800f580 comp rx=0 tx=0).stop 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d102a640 1 -- 172.21.15.103:0/2165000190 reap_dead start 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 shutdown_connections 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 >> 172.21.15.103:0/2165000190 conn(0x7f24cc06bd10 msgr2=0x7f24cc0c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 shutdown_connections 2024-09-19T05:40:33.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:33.945+0000 7f24d2a8d640 1 -- 172.21.15.103:0/2165000190 wait complete. 2024-09-19T05:40:33.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T05:40:34.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.055+0000 7f2592827640 1 Processor -- start 2024-09-19T05:40:34.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.055+0000 7f2592827640 1 -- start start 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f2592827640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 0x7f258c073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f2592827640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f258c155490 0x7f258c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f2592827640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258c0c9d00 con 0x7f258c06d730 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f2592827640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f258c15edb0 con 0x7f258c155490 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f2592827640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f258c0ca9b0 con 0x7f258c1550b0 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f258c06d730 0x7f258c0ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35010/0 (socket says 172.21.15.103:35010) 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258b7fe640 1 -- 172.21.15.103:0/768433159 learned_addr learned my addr 172.21.15.103:0/768433159 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:34.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342888884 0 0) 0x7f258c0c9d00 con 0x7f258c06d730 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258bfff640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 0x7f258c073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f2590dc4640 1 --2- 172.21.15.103:0/768433159 >> v2:172.21.15.174:3300/0 conn(0x7f258c155490 0x7f258c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2574003520 con 0x7f258c06d730 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3954842787 0 0) 0x7f2574003520 con 0x7f258c06d730 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 msgr2=0x7f258c073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 0x7f258c073f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 >> v2:172.21.15.174:3300/0 conn(0x7f258c155490 msgr2=0x7f258c0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 --2- 172.21.15.103:0/768433159 >> v2:172.21.15.174:3300/0 conn(0x7f258c155490 0x7f258c0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.056+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c15e4a0 con 0x7f258c06d730 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f2580001670 con 0x7f258c06d730 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 >> v1:172.21.15.103:6789/0 conn(0x7f258c06d730 legacy=0x7f258c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25740039b0 0x7f2574003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 0x7f2574004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2574004d40 0x7f25740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f258c15edb0 con 0x7f25740039b0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0ca9b0 con 0x7f2574004d40 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f257400b9c0 con 0x7f258c1550b0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258bfff640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25740039b0 0x7f2574003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258b7fe640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 0x7f2574004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f2590dc4640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2574004d40 0x7f25740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258bfff640 1 -- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 msgr2=0x7f2574004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258bfff640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f258c1550b0 0x7f2574004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258bfff640 1 -- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2574004d40 msgr2=0x7f25740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258bfff640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2574004d40 0x7f25740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.057+0000 7f258bfff640 1 -- 172.21.15.103:0/768433159 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2574003520 con 0x7f25740039b0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f258bfff640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25740039b0 0x7f2574003dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f257c009ac0 tx=0x7f2574005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5502e7ef12f439 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c036070 con 0x7f25740039b0 2024-09-19T05:40:34.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c031400 con 0x7f25740039b0 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f258affd640 1 -- 172.21.15.103:0/768433159 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c009690 con 0x7f25740039b0 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f2592827640 1 -- 172.21.15.103:0/768433159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25740039b0 msgr2=0x7f2574003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f2592827640 1 --2- 172.21.15.103:0/768433159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25740039b0 0x7f2574003dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f257c009ac0 tx=0x7f2574005830 comp rx=0 tx=0).stop 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f2590dc4640 1 -- 172.21.15.103:0/768433159 reap_dead start 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f2592827640 1 -- 172.21.15.103:0/768433159 shutdown_connections 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f2592827640 1 -- 172.21.15.103:0/768433159 >> 172.21.15.103:0/768433159 conn(0x7f258c06c240 msgr2=0x7f258c067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f2592827640 1 -- 172.21.15.103:0/768433159 shutdown_connections 2024-09-19T05:40:34.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.058+0000 7f2592827640 1 -- 172.21.15.103:0/768433159 wait complete. 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.059+0000 7f2592827640 1 Processor -- start 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f2592827640 1 -- start start 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f2592827640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25740039b0 0x7f258c14c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f2592827640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f258c150760 0x7f258c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f2592827640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f258c148020 0x7f258c1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f2592827640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f258c15ea40 con 0x7f258c150760 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f2592827640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f258c15e760 con 0x7f258c148020 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f2592827640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f258c15f240 con 0x7f25740039b0 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f258b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f258c150760 0x7f258c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f258b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f258c150760 0x7f258c151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39660/0 (socket says 172.21.15.103:39660) 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.060+0000 7f258b7fe640 1 -- 172.21.15.103:0/387259062 learned_addr learned my addr 172.21.15.103:0/387259062 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:34.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f2590dc4640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f258c148020 0x7f258c1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258bfff640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25740039b0 0x7f258c14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258b7fe640 1 -- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25740039b0 msgr2=0x7f258c14c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258b7fe640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25740039b0 0x7f258c14c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258b7fe640 1 -- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f258c148020 msgr2=0x7f258c1484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258b7fe640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f258c148020 0x7f258c1484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258b7fe640 1 -- 172.21.15.103:0/387259062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c14f3f0 con 0x7f258c150760 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258bfff640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25740039b0 0x7f258c14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f258b7fe640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f258c150760 0x7f258c151c70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2580007370 tx=0x7f2580007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f2588ff9640 1 -- 172.21.15.103:0/387259062 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258001a070 con 0x7f258c150760 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f2588ff9640 1 -- 172.21.15.103:0/387259062 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258000f9c0 con 0x7f258c150760 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c14e760 con 0x7f258c150760 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f2588ff9640 1 -- 172.21.15.103:0/387259062 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258000fdb0 con 0x7f258c150760 2024-09-19T05:40:34.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.061+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c14e9e0 con 0x7f258c150760 2024-09-19T05:40:34.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.062+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c074520 con 0x7f258c150760 2024-09-19T05:40:34.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.063+0000 7f2588ff9640 1 -- 172.21.15.103:0/387259062 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f258001d070 con 0x7f258c150760 2024-09-19T05:40:34.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.063+0000 7f2588ff9640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f257806c2b0 0x7f257806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.063+0000 7f258bfff640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f257806c2b0 0x7f257806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.063+0000 7f2588ff9640 1 -- 172.21.15.103:0/387259062 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f258008b0a0 con 0x7f258c150760 2024-09-19T05:40:34.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.064+0000 7f258bfff640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f257806c2b0 0x7f257806e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f257c033000 tx=0x7f257c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.067+0000 7f2588ff9640 1 -- 172.21.15.103:0/387259062 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f258c14e760 con 0x7f258c150760 2024-09-19T05:40:34.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.234+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f258c0c9710 con 0x7f257806c2b0 2024-09-19T05:40:34.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.235+0000 7f2588ff9640 1 -- 172.21.15.103:0/387259062 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f258c0c9710 con 0x7f257806c2b0 2024-09-19T05:40:34.237 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T05:40:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f257806c2b0 msgr2=0x7f257806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f257806c2b0 0x7f257806e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f257c033000 tx=0x7f257c008030 comp rx=0 tx=0).stop 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f258c150760 msgr2=0x7f258c151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f258c150760 0x7f258c151c70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2580007370 tx=0x7f2580007830 comp rx=0 tx=0).stop 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 shutdown_connections 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f257806c2b0 0x7f257806e770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f258c148020 0x7f258c1484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f258c150760 0x7f258c151c70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 --2- 172.21.15.103:0/387259062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25740039b0 0x7f258c14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 >> 172.21.15.103:0/387259062 conn(0x7f258c06c240 msgr2=0x7f258c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 shutdown_connections 2024-09-19T05:40:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.237+0000 7f2592827640 1 -- 172.21.15.103:0/387259062 wait complete. 2024-09-19T05:40:34.250 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T05:40:34.250 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.350+0000 7f9563c6e640 1 Processor -- start 2024-09-19T05:40:34.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.350+0000 7f9563c6e640 1 -- start start 2024-09-19T05:40:34.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9563c6e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f955c1550f0 0x7f955c15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9563c6e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb2b0 0x7f955c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9563c6e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f955c0cb6b0 0x7f955c06e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9563c6e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f955c15f2b0 con 0x7f955c1550f0 2024-09-19T05:40:34.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9563c6e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f955c15e450 con 0x7f955c0cb6b0 2024-09-19T05:40:34.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9563c6e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f955c15e730 con 0x7f955c0cb2b0 2024-09-19T05:40:34.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f955c1550f0 0x7f955c15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f955c1550f0 0x7f955c15b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39672/0 (socket says 172.21.15.103:39672) 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 -- 172.21.15.103:0/4037375949 learned_addr learned my addr 172.21.15.103:0/4037375949 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 -- 172.21.15.103:0/4037375949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb2b0 msgr2=0x7f955c06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f956220b640 1 --2- 172.21.15.103:0/4037375949 >> v2:172.21.15.174:3300/0 conn(0x7f955c0cb6b0 0x7f955c06e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561209640 1 --2- 172.21.15.103:0/4037375949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb2b0 0x7f955c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 --2- 172.21.15.103:0/4037375949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb2b0 0x7f955c06db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 -- 172.21.15.103:0/4037375949 >> v2:172.21.15.174:3300/0 conn(0x7f955c0cb6b0 msgr2=0x7f955c06e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 --2- 172.21.15.103:0/4037375949 >> v2:172.21.15.174:3300/0 conn(0x7f955c0cb6b0 0x7f955c06e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.351+0000 7f9561a0a640 1 -- 172.21.15.103:0/4037375949 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c15ea10 con 0x7f955c1550f0 2024-09-19T05:40:34.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.352+0000 7f9561a0a640 1 --2- 172.21.15.103:0/4037375949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c1550f0 0x7f955c15b8a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f955c06bca0 tx=0x7f955802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7391fb091be39d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.352+0000 7f9560a08640 1 -- 172.21.15.103:0/4037375949 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558036070 con 0x7f955c1550f0 2024-09-19T05:40:34.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.352+0000 7f9560a08640 1 -- 172.21.15.103:0/4037375949 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9558031600 con 0x7f955c1550f0 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.352+0000 7f9560a08640 1 -- 172.21.15.103:0/4037375949 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95580319d0 con 0x7f955c1550f0 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 -- 172.21.15.103:0/4037375949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c1550f0 msgr2=0x7f955c15b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 --2- 172.21.15.103:0/4037375949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c1550f0 0x7f955c15b8a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f955c06bca0 tx=0x7f955802a610 comp rx=0 tx=0).stop 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 -- 172.21.15.103:0/4037375949 shutdown_connections 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 --2- 172.21.15.103:0/4037375949 >> v2:172.21.15.174:3300/0 conn(0x7f955c0cb6b0 0x7f955c06e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 --2- 172.21.15.103:0/4037375949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb2b0 0x7f955c06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 --2- 172.21.15.103:0/4037375949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c1550f0 0x7f955c15b8a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 -- 172.21.15.103:0/4037375949 >> 172.21.15.103:0/4037375949 conn(0x7f955c06bd10 msgr2=0x7f955c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 -- 172.21.15.103:0/4037375949 shutdown_connections 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.353+0000 7f9563c6e640 1 -- 172.21.15.103:0/4037375949 wait complete. 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.354+0000 7f9563c6e640 1 Processor -- start 2024-09-19T05:40:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.354+0000 7f9563c6e640 1 -- start start 2024-09-19T05:40:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9563c6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c0cb2b0 0x7f955c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9563c6e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb6b0 0x7f955c1f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9563c6e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f955c1550f0 0x7f955c153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9563c6e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f955c1554d0 con 0x7f955c0cb2b0 2024-09-19T05:40:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9563c6e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f955c15efd0 con 0x7f955c1550f0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9563c6e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f955c0cc240 con 0x7f955c0cb6b0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c0cb2b0 0x7f955c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c0cb2b0 0x7f955c15bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39682/0 (socket says 172.21.15.103:39682) 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 -- 172.21.15.103:0/1025178170 learned_addr learned my addr 172.21.15.103:0/1025178170 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561209640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb6b0 0x7f955c1f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f956220b640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f955c1550f0 0x7f955c153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 -- 172.21.15.103:0/1025178170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb6b0 msgr2=0x7f955c1f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f955c0cb6b0 0x7f955c1f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 -- 172.21.15.103:0/1025178170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f955c1550f0 msgr2=0x7f955c153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f955c1550f0 0x7f955c153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 -- 172.21.15.103:0/1025178170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c14bc10 con 0x7f955c0cb2b0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.355+0000 7f9561a0a640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c0cb2b0 0x7f955c15bab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9558034040 tx=0x7f9558004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.356+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955803f020 con 0x7f955c0cb2b0 2024-09-19T05:40:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.356+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9558037040 con 0x7f955c0cb2b0 2024-09-19T05:40:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.356+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955c1f1c50 con 0x7f955c0cb2b0 2024-09-19T05:40:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.356+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558036070 con 0x7f955c0cb2b0 2024-09-19T05:40:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.356+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f955c1f5020 con 0x7f955c0cb2b0 2024-09-19T05:40:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.356+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f955c0b3540 con 0x7f955c0cb2b0 2024-09-19T05:40:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.357+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9558042020 con 0x7f955c0cb2b0 2024-09-19T05:40:34.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.357+0000 7f95527fc640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f954006c2b0 0x7f954006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.357+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f95580abf30 con 0x7f955c0cb2b0 2024-09-19T05:40:34.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.357+0000 7f9561209640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f954006c2b0 0x7f954006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.358+0000 7f95527fc640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f9540075cd0 0x7f9540078170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.358+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 --> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9558041e50 con 0x7f9540075cd0 2024-09-19T05:40:34.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.358+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95580ae630 con 0x7f955c0cb2b0 2024-09-19T05:40:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.358+0000 7f956220b640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f9540075cd0 0x7f9540078170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.358+0000 7f9561209640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f954006c2b0 0x7f954006e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.358+0000 7f956220b640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f9540075cd0 0x7f9540078170 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.359+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== osd.2 v2:172.21.15.103:6824/2608335916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9558041e50 con 0x7f9540075cd0 2024-09-19T05:40:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.371+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 --> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f955c15b8a0 con 0x7f9540075cd0 2024-09-19T05:40:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.371+0000 7f95527fc640 1 -- 172.21.15.103:0/1025178170 <== osd.2 v2:172.21.15.103:6824/2608335916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f955c15b8a0 con 0x7f9540075cd0 2024-09-19T05:40:34.374 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:34.374 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:34.374 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.371+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f9540075cd0 msgr2=0x7f9540078170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.371+0000 7f9563c6e640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6824/2608335916,v1:172.21.15.103:6825/2608335916] conn(0x7f9540075cd0 0x7f9540078170 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f954006c2b0 msgr2=0x7f954006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f954006c2b0 0x7f954006e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).stop 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c0cb2b0 msgr2=0x7f955c15bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 --2- 172.21.15.103:0/1025178170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f955c0cb2b0 0x7f955c15bab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9558034040 tx=0x7f9558004a40 comp rx=0 tx=0).stop 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f956220b640 1 -- 172.21.15.103:0/1025178170 reap_dead start 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 shutdown_connections 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 >> 172.21.15.103:0/1025178170 conn(0x7f955c06bd10 msgr2=0x7f955c0c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 shutdown_connections 2024-09-19T05:40:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.372+0000 7f9563c6e640 1 -- 172.21.15.103:0/1025178170 wait complete. 2024-09-19T05:40:34.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T05:40:34.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.482+0000 7fd117703640 1 Processor -- start 2024-09-19T05:40:34.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.482+0000 7fd117703640 1 -- start start 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd117703640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 0x7fd1100c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd117703640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd11015bc80 con 0x7fd110151ea0 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd117703640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd110157c70 con 0x7fd1100c46c0 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd117703640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd1101585a0 con 0x7fd1100c3a50 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd11549f640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd110151ea0 0x7fd110158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35024/0 (socket says 172.21.15.103:35024) 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd11549f640 1 -- 172.21.15.103:0/1338781928 learned_addr learned my addr 172.21.15.103:0/1338781928 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669414012 0 0) 0x7fd11015bc80 con 0x7fd110151ea0 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0fc003520 con 0x7fd110151ea0 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd115ca0640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 0x7fd1100c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3294779313 0 0) 0x7fd0fc003520 con 0x7fd110151ea0 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 msgr2=0x7fd1100c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 0x7fd1100c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 >> v1:172.21.15.174:6789/0 conn(0x7fd1100c46c0 legacy=0x7fd11006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd110157f50 con 0x7fd110151ea0 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fd10c001670 con 0x7fd110151ea0 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd115ca0640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 0x7fd1100c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.483+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 >> v1:172.21.15.103:6789/0 conn(0x7fd110151ea0 legacy=0x7fd110158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd107fff640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0039e0 0x7fd0fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd107fff640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 0x7fd0fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd107fff640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0fc004d40 0x7fd0fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1101585a0 con 0x7fd0fc0039e0 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc00bad0 con 0x7fd0fc004d40 2024-09-19T05:40:34.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc00bcd0 con 0x7fd1100c3a50 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd11549f640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0039e0 0x7fd0fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd115ca0640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0fc004d40 0x7fd0fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd114c9e640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 0x7fd0fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd11549f640 1 -- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 msgr2=0x7fd0fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd11549f640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100c3a50 0x7fd0fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd11549f640 1 -- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0fc004d40 msgr2=0x7fd0fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd11549f640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0fc004d40 0x7fd0fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.484+0000 7fd11549f640 1 -- 172.21.15.103:0/1338781928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc003520 con 0x7fd0fc0039e0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd11549f640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0039e0 0x7fd0fc003e00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd10c001eb0 tx=0x7fd0fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4f4f22626f5f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c007d30 con 0x7fd0fc0039e0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10c005af0 con 0x7fd0fc0039e0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd107fff640 1 -- 172.21.15.103:0/1338781928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c007070 con 0x7fd0fc0039e0 2024-09-19T05:40:34.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd117703640 1 -- 172.21.15.103:0/1338781928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0039e0 msgr2=0x7fd0fc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd117703640 1 --2- 172.21.15.103:0/1338781928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0039e0 0x7fd0fc003e00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd10c001eb0 tx=0x7fd0fc005830 comp rx=0 tx=0).stop 2024-09-19T05:40:34.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd115ca0640 1 -- 172.21.15.103:0/1338781928 reap_dead start 2024-09-19T05:40:34.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd117703640 1 -- 172.21.15.103:0/1338781928 shutdown_connections 2024-09-19T05:40:34.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd117703640 1 -- 172.21.15.103:0/1338781928 >> 172.21.15.103:0/1338781928 conn(0x7fd1100c9230 msgr2=0x7fd1100c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd117703640 1 -- 172.21.15.103:0/1338781928 shutdown_connections 2024-09-19T05:40:34.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.485+0000 7fd117703640 1 -- 172.21.15.103:0/1338781928 wait complete. 2024-09-19T05:40:34.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.486+0000 7fd117703640 1 Processor -- start 2024-09-19T05:40:34.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd117703640 1 -- start start 2024-09-19T05:40:34.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd117703640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0fc0039e0 0x7fd1100cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd117703640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd11014ed70 0x7fd11014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd117703640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1100ca6d0 0x7fd1100cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd117703640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1101596e0 con 0x7fd11014ed70 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd117703640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd110152280 con 0x7fd1100ca6d0 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd117703640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd110158a30 con 0x7fd0fc0039e0 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd114c9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd11014ed70 0x7fd11014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd114c9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd11014ed70 0x7fd11014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39708/0 (socket says 172.21.15.103:39708) 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.487+0000 7fd114c9e640 1 -- 172.21.15.103:0/595499723 learned_addr learned my addr 172.21.15.103:0/595499723 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd114c9e640 1 -- 172.21.15.103:0/595499723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0fc0039e0 msgr2=0x7fd1100cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd114c9e640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0fc0039e0 0x7fd1100cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd114c9e640 1 -- 172.21.15.103:0/595499723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1100ca6d0 msgr2=0x7fd1100cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd114c9e640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1100ca6d0 0x7fd1100cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd114c9e640 1 -- 172.21.15.103:0/595499723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd110074130 con 0x7fd11014ed70 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd114c9e640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd11014ed70 0x7fd11014ded0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd10000f980 tx=0x7fd10000fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd105ffb640 1 -- 172.21.15.103:0/595499723 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100015070 con 0x7fd11014ed70 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd105ffb640 1 -- 172.21.15.103:0/595499723 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10000e850 con 0x7fd11014ed70 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1100cb090 con 0x7fd11014ed70 2024-09-19T05:40:34.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd105ffb640 1 -- 172.21.15.103:0/595499723 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10000ec40 con 0x7fd11014ed70 2024-09-19T05:40:34.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.488+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd110073310 con 0x7fd11014ed70 2024-09-19T05:40:34.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.489+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11015bf20 con 0x7fd11014ed70 2024-09-19T05:40:34.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.490+0000 7fd105ffb640 1 -- 172.21.15.103:0/595499723 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd100018070 con 0x7fd11014ed70 2024-09-19T05:40:34.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.490+0000 7fd105ffb640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd0f406c2b0 0x7fd0f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.490+0000 7fd105ffb640 1 -- 172.21.15.103:0/595499723 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd10008ba30 con 0x7fd11014ed70 2024-09-19T05:40:34.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.490+0000 7fd11549f640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd0f406c2b0 0x7fd0f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.490+0000 7fd11549f640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd0f406c2b0 0x7fd0f406e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd10c032000 tx=0x7fd10c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.494+0000 7fd105ffb640 1 -- 172.21.15.103:0/595499723 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd100059da0 con 0x7fd11014ed70 2024-09-19T05:40:34.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.661+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd1100c7000 con 0x7fd0f406c2b0 2024-09-19T05:40:34.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.661+0000 7fd105ffb640 1 -- 172.21.15.103:0/595499723 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1100c7000 con 0x7fd0f406c2b0 2024-09-19T05:40:34.664 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T05:40:34.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.663+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd0f406c2b0 msgr2=0x7fd0f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.663+0000 7fd117703640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd0f406c2b0 0x7fd0f406e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd10c032000 tx=0x7fd10c009030 comp rx=0 tx=0).stop 2024-09-19T05:40:34.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.663+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd11014ed70 msgr2=0x7fd11014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.663+0000 7fd117703640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd11014ed70 0x7fd11014ded0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd10000f980 tx=0x7fd10000fe40 comp rx=0 tx=0).stop 2024-09-19T05:40:34.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 shutdown_connections 2024-09-19T05:40:34.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fd0f406c2b0 0x7fd0f406e770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1100ca6d0 0x7fd1100cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd11014ed70 0x7fd11014ded0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 --2- 172.21.15.103:0/595499723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0fc0039e0 0x7fd1100cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 >> 172.21.15.103:0/595499723 conn(0x7fd1100c9230 msgr2=0x7fd110150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 shutdown_connections 2024-09-19T05:40:34.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.664+0000 7fd117703640 1 -- 172.21.15.103:0/595499723 wait complete. 2024-09-19T05:40:34.677 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T05:40:34.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:34.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.777+0000 7fe56dc77640 1 Processor -- start 2024-09-19T05:40:34.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.777+0000 7fe56dc77640 1 -- start start 2024-09-19T05:40:34.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.778+0000 7fe56dc77640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe5680cda10 0x7fe56815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.778+0000 7fe56dc77640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56815ef30 con 0x7fe5680c5760 2024-09-19T05:40:34.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.778+0000 7fe56dc77640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56815f210 con 0x7fe568155040 2024-09-19T05:40:34.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.778+0000 7fe56dc77640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe5680ccf30 con 0x7fe5680cda10 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.778+0000 7fe567fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe5680c5760 0x7fe5680cb8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35038/0 (socket says 172.21.15.103:35038) 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.778+0000 7fe567fff640 1 -- 172.21.15.103:0/2081954040 learned_addr learned my addr 172.21.15.103:0/2081954040 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe566ffd640 1 --2- 172.21.15.103:0/2081954040 >> v2:172.21.15.174:3300/0 conn(0x7fe5680cda10 0x7fe56815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728471464 0 0) 0x7fe56815ef30 con 0x7fe5680c5760 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe554003520 con 0x7fe5680c5760 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1682412989 0 0) 0x7fe554003520 con 0x7fe5680c5760 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 >> v2:172.21.15.174:3300/0 conn(0x7fe5680cda10 msgr2=0x7fe56815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 --2- 172.21.15.103:0/2081954040 >> v2:172.21.15.174:3300/0 conn(0x7fe5680cda10 0x7fe56815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 >> v1:172.21.15.174:6789/0 conn(0x7fe568155040 legacy=0x7fe56815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5680cd210 con 0x7fe5680c5760 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fe5600019f0 con 0x7fe5680c5760 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 >> v1:172.21.15.103:6789/0 conn(0x7fe5680c5760 legacy=0x7fe5680cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5540039b0 0x7fe554003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe554004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5540051c0 0x7fe55400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe5680ccf30 con 0x7fe554004800 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe55400c060 con 0x7fe5540051c0 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe55400c260 con 0x7fe5540039b0 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe566ffd640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe554004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe567fff640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5540051c0 0x7fe55400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe5677fe640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5540039b0 0x7fe554003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe566ffd640 1 -- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5540039b0 msgr2=0x7fe554003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe566ffd640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5540039b0 0x7fe554003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe566ffd640 1 -- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5540051c0 msgr2=0x7fe55400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:34.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe566ffd640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5540051c0 0x7fe55400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe566ffd640 1 -- 172.21.15.103:0/2081954040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe554003520 con 0x7fe554004800 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.779+0000 7fe567fff640 1 -- 172.21.15.103:0/2081954040 reap_dead start 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.780+0000 7fe566ffd640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe554004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe550009ab0 tx=0x7fe554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4267b137c1a9eb41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.780+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550036070 con 0x7fe554004800 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.780+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe550005990 con 0x7fe554004800 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.780+0000 7fe5667fc640 1 -- 172.21.15.103:0/2081954040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550009680 con 0x7fe554004800 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.781+0000 7fe56dc77640 1 -- 172.21.15.103:0/2081954040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 msgr2=0x7fe554004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.781+0000 7fe56dc77640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe554004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe550009ab0 tx=0x7fe554005830 comp rx=0 tx=0).stop 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.781+0000 7fe56dc77640 1 -- 172.21.15.103:0/2081954040 shutdown_connections 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.781+0000 7fe56dc77640 1 --2- 172.21.15.103:0/2081954040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe554004c80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.781+0000 7fe56dc77640 1 -- 172.21.15.103:0/2081954040 >> 172.21.15.103:0/2081954040 conn(0x7fe568073340 msgr2=0x7fe568073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.781+0000 7fe56dc77640 1 -- 172.21.15.103:0/2081954040 shutdown_connections 2024-09-19T05:40:34.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.781+0000 7fe56dc77640 1 -- 172.21.15.103:0/2081954040 wait complete. 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.782+0000 7fe56dc77640 1 Processor -- start 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.782+0000 7fe56dc77640 1 -- start start 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe56dc77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe5681f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe5677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe5681f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe5677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe5681f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39724/0 (socket says 172.21.15.103:39724) 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe5677fe640 1 -- 172.21.15.103:0/3603993927 learned_addr learned my addr 172.21.15.103:0/3603993927 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe56dc77640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5681502d0 0x7fe5681f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe56dc77640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5680c7bc0 0x7fe568151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe568155420 con 0x7fe554004800 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5680c5b40 con 0x7fe5681502d0 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe5681555a0 con 0x7fe5680c7bc0 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe566ffd640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5681502d0 0x7fe5681f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.783+0000 7fe567fff640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5680c7bc0 0x7fe568151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe5677fe640 1 -- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5680c7bc0 msgr2=0x7fe568151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe5677fe640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5680c7bc0 0x7fe568151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe5677fe640 1 -- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5681502d0 msgr2=0x7fe5681f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe5677fe640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5681502d0 0x7fe5681f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe5677fe640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe568150b90 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe566ffd640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5681502d0 0x7fe5681f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe5677fe640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe5681f1700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe55800f620 tx=0x7fe55800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5580052e0 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe558018070 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558003810 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5680b6a60 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.784+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe568150e00 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.785+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe56815af00 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.785+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe5580039b0 con 0x7fe554004800 2024-09-19T05:40:34.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe55ffff640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe54806c2e0 0x7fe54806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe55808b5e0 con 0x7fe554004800 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe566ffd640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe54806c2e0 0x7fe54806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe55ffff640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7fe548075d00 0x7fe5480781a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe558019ec0 con 0x7fe548075d00 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe558092050 con 0x7fe554004800 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe567fff640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7fe548075d00 0x7fe5480781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.786+0000 7fe566ffd640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe54806c2e0 0x7fe54806e7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe550033000 tx=0x7fe550008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.787+0000 7fe567fff640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7fe548075d00 0x7fe5480781a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.787+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== osd.3 v2:172.21.15.103:6816/2269860310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe558019ec0 con 0x7fe548075d00 2024-09-19T05:40:34.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.799+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 --> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe5680cc340 con 0x7fe548075d00 2024-09-19T05:40:34.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe55ffff640 1 -- 172.21.15.103:0/3603993927 <== osd.3 v2:172.21.15.103:6816/2269860310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe5680cc340 con 0x7fe548075d00 2024-09-19T05:40:34.802 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:34.803 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:34.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7fe548075d00 msgr2=0x7fe5480781a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6816/2269860310,v1:172.21.15.103:6817/2269860310] conn(0x7fe548075d00 0x7fe5480781a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe54806c2e0 msgr2=0x7fe54806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fe54806c2e0 0x7fe54806e7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe550033000 tx=0x7fe550008030 comp rx=0 tx=0).stop 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 msgr2=0x7fe5681f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 --2- 172.21.15.103:0/3603993927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554004800 0x7fe5681f1700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe55800f620 tx=0x7fe55800fae0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe567fff640 1 -- 172.21.15.103:0/3603993927 reap_dead start 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 shutdown_connections 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 >> 172.21.15.103:0/3603993927 conn(0x7fe568073340 msgr2=0x7fe5680c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 shutdown_connections 2024-09-19T05:40:34.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.800+0000 7fe56dc77640 1 -- 172.21.15.103:0/3603993927 wait complete. 2024-09-19T05:40:34.813 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T05:40:34.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.914+0000 7f3fe8f6d640 1 Processor -- start 2024-09-19T05:40:34.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.915+0000 7f3fe8f6d640 1 -- start start 2024-09-19T05:40:34.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.915+0000 7f3fe8f6d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.915+0000 7f3fe8f6d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe40cbed0 con 0x7f3fe4155040 2024-09-19T05:40:34.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.915+0000 7f3fe8f6d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe415bd70 con 0x7f3fe40c5950 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.915+0000 7f3fe8f6d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe40cbbf0 con 0x7f3fe40b3540 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe259c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3fe4155040 0x7f3fe415e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35054/0 (socket says 172.21.15.103:35054) 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe259c640 1 -- 172.21.15.103:0/2878794859 learned_addr learned my addr 172.21.15.103:0/2878794859 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe1d9b640 1 --2- 172.21.15.103:0/2878794859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe159a640 1 -- 172.21.15.103:0/2878794859 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350041727 0 0) 0x7f3fe40cbed0 con 0x7f3fe4155040 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe159a640 1 -- 172.21.15.103:0/2878794859 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd0003520 con 0x7f3fe4155040 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe159a640 1 -- 172.21.15.103:0/2878794859 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547020189 0 0) 0x7f3fe415bd70 con 0x7f3fe40c5950 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe159a640 1 -- 172.21.15.103:0/2878794859 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fe40cbed0 con 0x7f3fe40c5950 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe1d9b640 1 -- 172.21.15.103:0/2878794859 >> v1:172.21.15.174:6789/0 conn(0x7f3fe40c5950 legacy=0x7f3fe40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe1d9b640 1 -- 172.21.15.103:0/2878794859 >> v1:172.21.15.103:6789/0 conn(0x7f3fe4155040 legacy=0x7f3fe415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.916+0000 7f3fe1d9b640 1 -- 172.21.15.103:0/2878794859 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe415afb0 con 0x7f3fe40b3540 2024-09-19T05:40:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.917+0000 7f3fe1d9b640 1 --2- 172.21.15.103:0/2878794859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe40cb540 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0097d0 tx=0x7f3fcc02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12b703f08feb89de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.917+0000 7f3fe159a640 1 -- 172.21.15.103:0/2878794859 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc037070 con 0x7f3fe40b3540 2024-09-19T05:40:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.917+0000 7f3fe159a640 1 -- 172.21.15.103:0/2878794859 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc032440 con 0x7f3fe40b3540 2024-09-19T05:40:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.917+0000 7f3fe159a640 1 -- 172.21.15.103:0/2878794859 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc0327f0 con 0x7f3fe40b3540 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.918+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/2878794859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 msgr2=0x7f3fe40cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.918+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/2878794859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe40cb540 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0097d0 tx=0x7f3fcc02a290 comp rx=0 tx=0).stop 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.918+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/2878794859 shutdown_connections 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.918+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/2878794859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe40cb540 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.918+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/2878794859 >> 172.21.15.103:0/2878794859 conn(0x7f3fe4073340 msgr2=0x7f3fe4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.918+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/2878794859 shutdown_connections 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.918+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/2878794859 wait complete. 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.919+0000 7f3fe8f6d640 1 Processor -- start 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.919+0000 7f3fe8f6d640 1 -- start start 2024-09-19T05:40:34.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe8f6d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe4158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe8f6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe40c5950 0x7f3fe41592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe8f6d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe4155040 0x7f3fe415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe8f6d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe415b850 con 0x7f3fe40c5950 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe8f6d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe415b570 con 0x7f3fe4155040 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe8f6d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe415eb30 con 0x7f3fe40b3540 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe40c5950 0x7f3fe41592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe40c5950 0x7f3fe41592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39734/0 (socket says 172.21.15.103:39734) 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 -- 172.21.15.103:0/836714910 learned_addr learned my addr 172.21.15.103:0/836714910 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe259c640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe4158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe2d9d640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe4155040 0x7f3fe415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 -- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 msgr2=0x7f3fe4158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe4158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 -- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe4155040 msgr2=0x7f3fe415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe4155040 0x7f3fe415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 -- 172.21.15.103:0/836714910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe40b48c0 con 0x7f3fe40c5950 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.920+0000 7f3fe1d9b640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe40c5950 0x7f3fe41592e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc02a2d0 tx=0x7f3fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.921+0000 7f3fdaffd640 1 -- 172.21.15.103:0/836714910 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc041020 con 0x7f3fe40c5950 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.921+0000 7f3fdaffd640 1 -- 172.21.15.103:0/836714910 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc03d6e0 con 0x7f3fe40c5950 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.921+0000 7f3fdaffd640 1 -- 172.21.15.103:0/836714910 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc037040 con 0x7f3fe40c5950 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.921+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe40b65e0 con 0x7f3fe40c5950 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.921+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe41f1ba0 con 0x7f3fe40c5950 2024-09-19T05:40:34.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.921+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe40cb540 con 0x7f3fe40c5950 2024-09-19T05:40:34.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.922+0000 7f3fdaffd640 1 -- 172.21.15.103:0/836714910 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3fcc044020 con 0x7f3fe40c5950 2024-09-19T05:40:34.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.922+0000 7f3fdaffd640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fc406c2b0 0x7f3fc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:34.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.923+0000 7f3fdaffd640 1 -- 172.21.15.103:0/836714910 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3fcc0abf00 con 0x7f3fe40c5950 2024-09-19T05:40:34.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.923+0000 7f3fe259c640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fc406c2b0 0x7f3fc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:34.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.923+0000 7f3fe259c640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fc406c2b0 0x7f3fc406e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4000f60 tx=0x7f3fd4007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:34.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:34.927+0000 7f3fdaffd640 1 -- 172.21.15.103:0/836714910 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3fcc04b030 con 0x7f3fe40c5950 2024-09-19T05:40:35.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.093+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3fe4069380 con 0x7f3fc406c2b0 2024-09-19T05:40:35.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.094+0000 7f3fdaffd640 1 -- 172.21.15.103:0/836714910 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3fe4069380 con 0x7f3fc406c2b0 2024-09-19T05:40:35.096 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T05:40:35.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fc406c2b0 msgr2=0x7f3fc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fc406c2b0 0x7f3fc406e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4000f60 tx=0x7f3fd4007d70 comp rx=0 tx=0).stop 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe40c5950 msgr2=0x7f3fe41592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe40c5950 0x7f3fe41592e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc02a2d0 tx=0x7f3fcc0046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 shutdown_connections 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3fc406c2b0 0x7f3fc406e770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fe4155040 0x7f3fe415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fe40c5950 0x7f3fe41592e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 --2- 172.21.15.103:0/836714910 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe40b3540 0x7f3fe4158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 >> 172.21.15.103:0/836714910 conn(0x7f3fe4073340 msgr2=0x7f3fe40c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 shutdown_connections 2024-09-19T05:40:35.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.096+0000 7f3fe8f6d640 1 -- 172.21.15.103:0/836714910 wait complete. 2024-09-19T05:40:35.109 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T05:40:35.109 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:35.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.210+0000 7fb235386640 1 Processor -- start 2024-09-19T05:40:35.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.210+0000 7fb235386640 1 -- start start 2024-09-19T05:40:35.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb235386640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2300cbfc0 0x7fb23015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb235386640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23015ef30 con 0x7fb2300cda10 2024-09-19T05:40:35.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb235386640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23015f210 con 0x7fb230155040 2024-09-19T05:40:35.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb235386640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb2300ccf30 con 0x7fb2300cbfc0 2024-09-19T05:40:35.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb22e7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb2300cda10 0x7fb2300cb8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35070/0 (socket says 172.21.15.103:35070) 2024-09-19T05:40:35.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb22e7fc640 1 -- 172.21.15.103:0/2709470349 learned_addr learned my addr 172.21.15.103:0/2709470349 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:35.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb22f7fe640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2300cbfc0 0x7fb23015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809171444 0 0) 0x7fb23015ef30 con 0x7fb2300cda10 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb21c003520 con 0x7fb2300cda10 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.211+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3881447890 0 0) 0x7fb21c003520 con 0x7fb2300cda10 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2300cbfc0 msgr2=0x7fb23015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2300cbfc0 0x7fb23015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 >> v1:172.21.15.174:6789/0 conn(0x7fb230155040 legacy=0x7fb23015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2300cd210 con 0x7fb2300cda10 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fb2180017f0 con 0x7fb2300cda10 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 >> v1:172.21.15.103:6789/0 conn(0x7fb2300cda10 legacy=0x7fb2300cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb21c0039e0 0x7fb21c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb21c004390 0x7fb21c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c004f80 0x7fb21c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb2300ccf30 con 0x7fb21c0039e0 2024-09-19T05:40:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c00bf00 con 0x7fb21c004f80 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c00c080 con 0x7fb21c004390 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22effd640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb21c0039e0 0x7fb21c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22e7fc640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb21c004390 0x7fb21c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22f7fe640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c004f80 0x7fb21c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22effd640 1 -- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb21c004390 msgr2=0x7fb21c004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22effd640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb21c004390 0x7fb21c004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22effd640 1 -- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c004f80 msgr2=0x7fb21c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22effd640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c004f80 0x7fb21c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.212+0000 7fb22effd640 1 -- 172.21.15.103:0/2709470349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c003520 con 0x7fb21c0039e0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb22effd640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb21c0039e0 0x7fb21c003dc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb220001f60 tx=0x7fb21c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45995ab197c0a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220001b30 con 0x7fb21c0039e0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb220031620 con 0x7fb21c0039e0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb22dffb640 1 -- 172.21.15.103:0/2709470349 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220031a10 con 0x7fb21c0039e0 2024-09-19T05:40:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb235386640 1 -- 172.21.15.103:0/2709470349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb21c0039e0 msgr2=0x7fb21c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb235386640 1 --2- 172.21.15.103:0/2709470349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb21c0039e0 0x7fb21c003dc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb220001f60 tx=0x7fb21c005830 comp rx=0 tx=0).stop 2024-09-19T05:40:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb22f7fe640 1 -- 172.21.15.103:0/2709470349 reap_dead start 2024-09-19T05:40:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb235386640 1 -- 172.21.15.103:0/2709470349 shutdown_connections 2024-09-19T05:40:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb235386640 1 -- 172.21.15.103:0/2709470349 >> 172.21.15.103:0/2709470349 conn(0x7fb230073340 msgr2=0x7fb230073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb235386640 1 -- 172.21.15.103:0/2709470349 shutdown_connections 2024-09-19T05:40:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.213+0000 7fb235386640 1 -- 172.21.15.103:0/2709470349 wait complete. 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.215+0000 7fb235386640 1 Processor -- start 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.215+0000 7fb235386640 1 -- start start 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.215+0000 7fb235386640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c0039e0 0x7fb2301503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.215+0000 7fb235386640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb23014ef80 0x7fb23015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.215+0000 7fb235386640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2301f4470 0x7fb2301f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.215+0000 7fb235386640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb230155420 con 0x7fb2301f4470 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.215+0000 7fb235386640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb23015ec00 con 0x7fb21c0039e0 2024-09-19T05:40:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb235386640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb2301555a0 con 0x7fb23014ef80 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2301f4470 0x7fb2301f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2301f4470 0x7fb2301f48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39760/0 (socket says 172.21.15.103:39760) 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 -- 172.21.15.103:0/1052938229 learned_addr learned my addr 172.21.15.103:0/1052938229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22e7fc640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb23014ef80 0x7fb23015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22effd640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c0039e0 0x7fb2301503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 -- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb23014ef80 msgr2=0x7fb23015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb23014ef80 0x7fb23015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 -- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c0039e0 msgr2=0x7fb2301503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb21c0039e0 0x7fb2301503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 -- 172.21.15.103:0/1052938229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2301f0800 con 0x7fb2301f4470 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb22f7fe640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2301f4470 0x7fb2301f48f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb2300caec0 tx=0x7fb228011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228019020 con 0x7fb2301f4470 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb228003610 con 0x7fb2301f4470 2024-09-19T05:40:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23014f4c0 con 0x7fb2301f4470 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228003a00 con 0x7fb2301f4470 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.216+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2300caab0 con 0x7fb2301f4470 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.217+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2300ca580 con 0x7fb2301f4470 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.218+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb22801c020 con 0x7fb2301f4470 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.218+0000 7fb2277fe640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb21006c2e0 0x7fb21006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.218+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb22808b8e0 con 0x7fb2301f4470 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.218+0000 7fb22effd640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb21006c2e0 0x7fb21006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.218+0000 7fb2277fe640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fb210075d00 0x7fb2100781a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.218+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 --> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb210078870 con 0x7fb210075d00 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.218+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2280902c0 con 0x7fb2301f4470 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.219+0000 7fb22e7fc640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fb210075d00 0x7fb2100781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.219+0000 7fb22effd640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb21006c2e0 0x7fb21006e7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb220034000 tx=0x7fb22002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.219+0000 7fb22e7fc640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fb210075d00 0x7fb2100781a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.220+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== osd.4 v2:172.21.15.174:6824/1847922711 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb210078870 con 0x7fb210075d00 2024-09-19T05:40:35.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.232+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 --> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb23004ffb0 con 0x7fb210075d00 2024-09-19T05:40:35.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb2277fe640 1 -- 172.21.15.103:0/1052938229 <== osd.4 v2:172.21.15.174:6824/1847922711 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb23004ffb0 con 0x7fb210075d00 2024-09-19T05:40:35.235 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:35.235 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:35.235 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:35.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fb210075d00 msgr2=0x7fb2100781a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.174:6824/1847922711,v1:172.21.15.174:6825/1847922711] conn(0x7fb210075d00 0x7fb2100781a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb21006c2e0 msgr2=0x7fb21006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb21006c2e0 0x7fb21006e7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb220034000 tx=0x7fb22002f000 comp rx=0 tx=0).stop 2024-09-19T05:40:35.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2301f4470 msgr2=0x7fb2301f48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 --2- 172.21.15.103:0/1052938229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2301f4470 0x7fb2301f48f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb2300caec0 tx=0x7fb228011920 comp rx=0 tx=0).stop 2024-09-19T05:40:35.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb22f7fe640 1 -- 172.21.15.103:0/1052938229 reap_dead start 2024-09-19T05:40:35.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 shutdown_connections 2024-09-19T05:40:35.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 >> 172.21.15.103:0/1052938229 conn(0x7fb230073340 msgr2=0x7fb2300cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 shutdown_connections 2024-09-19T05:40:35.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.234+0000 7fb235386640 1 -- 172.21.15.103:0/1052938229 wait complete. 2024-09-19T05:40:35.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T05:40:35.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.345+0000 7f70b8d52640 1 Processor -- start 2024-09-19T05:40:35.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.345+0000 7f70b8d52640 1 -- start start 2024-09-19T05:40:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b8d52640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b4073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b8d52640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70b406d730 0x7f70b40ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b8d52640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70b40c9d00 con 0x7f70b4155490 2024-09-19T05:40:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b8d52640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f70b415edb0 con 0x7f70b406d730 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b8d52640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f70b415e4a0 con 0x7f70b41550b0 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70b406d730 0x7f70b40ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70b406d730 0x7f70b40ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39772/0 (socket says 172.21.15.103:39772) 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b1d9b640 1 -- 172.21.15.103:0/1515656904 learned_addr learned my addr 172.21.15.103:0/1515656904 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b259c640 1 --2- 172.21.15.103:0/1515656904 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b4073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b1d9b640 1 -- 172.21.15.103:0/1515656904 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 msgr2=0x7f70b4073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b1d9b640 1 --2- 172.21.15.103:0/1515656904 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b4073f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b1d9b640 1 -- 172.21.15.103:0/1515656904 >> v1:172.21.15.103:6789/0 conn(0x7f70b4155490 legacy=0x7f70b40ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.346+0000 7f70b1d9b640 1 -- 172.21.15.103:0/1515656904 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b40c9fc0 con 0x7f70b406d730 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.347+0000 7f70b1d9b640 1 --2- 172.21.15.103:0/1515656904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b406d730 0x7f70b40ca2a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009870 tx=0x7f70a802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4051b508678d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.347+0000 7f70b159a640 1 -- 172.21.15.103:0/1515656904 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8037070 con 0x7f70b406d730 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.347+0000 7f70b159a640 1 -- 172.21.15.103:0/1515656904 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a802ae50 con 0x7f70b406d730 2024-09-19T05:40:35.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.347+0000 7f70b159a640 1 -- 172.21.15.103:0/1515656904 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8032860 con 0x7f70b406d730 2024-09-19T05:40:35.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 -- 172.21.15.103:0/1515656904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b406d730 msgr2=0x7f70b40ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 --2- 172.21.15.103:0/1515656904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b406d730 0x7f70b40ca2a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009870 tx=0x7f70a802a300 comp rx=0 tx=0).stop 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 -- 172.21.15.103:0/1515656904 shutdown_connections 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 --2- 172.21.15.103:0/1515656904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b406d730 0x7f70b40ca2a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 --2- 172.21.15.103:0/1515656904 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b4073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 -- 172.21.15.103:0/1515656904 >> 172.21.15.103:0/1515656904 conn(0x7f70b406c240 msgr2=0x7f70b4067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 -- 172.21.15.103:0/1515656904 shutdown_connections 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.348+0000 7f70b8d52640 1 -- 172.21.15.103:0/1515656904 wait complete. 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.349+0000 7f70b8d52640 1 Processor -- start 2024-09-19T05:40:35.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.349+0000 7f70b8d52640 1 -- start start 2024-09-19T05:40:35.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b8d52640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b40c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b8d52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b4155490 0x7f70b40c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b8d52640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70b41566f0 0x7f70b414b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b8d52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70b415f240 con 0x7f70b4155490 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b8d52640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f70b415ea40 con 0x7f70b41566f0 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b8d52640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f70b415e270 con 0x7f70b41550b0 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b4155490 0x7f70b40c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b4155490 0x7f70b40c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39780/0 (socket says 172.21.15.103:39780) 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 -- 172.21.15.103:0/2136336693 learned_addr learned my addr 172.21.15.103:0/2136336693 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b259c640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b40c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b2d9d640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70b41566f0 0x7f70b414b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 -- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 msgr2=0x7f70b40c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b40c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 -- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70b41566f0 msgr2=0x7f70b414b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70b41566f0 0x7f70b414b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 -- 172.21.15.103:0/2136336693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b41560d0 con 0x7f70b4155490 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b1d9b640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b4155490 0x7f70b40c5390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000c00 tx=0x7f70a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70a2ffd640 1 -- 172.21.15.103:0/2136336693 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8041070 con 0x7f70b4155490 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70a2ffd640 1 -- 172.21.15.103:0/2136336693 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a803c670 con 0x7f70b4155490 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b415df90 con 0x7f70b4155490 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.350+0000 7f70a2ffd640 1 -- 172.21.15.103:0/2136336693 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8037040 con 0x7f70b4155490 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.351+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b40ce1a0 con 0x7f70b4155490 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.351+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b414f960 con 0x7f70b4155490 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.352+0000 7f70a2ffd640 1 -- 172.21.15.103:0/2136336693 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70a8044070 con 0x7f70b4155490 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.352+0000 7f70a2ffd640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f709406c2b0 0x7f709406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.352+0000 7f70a2ffd640 1 -- 172.21.15.103:0/2136336693 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f70a80abff0 con 0x7f70b4155490 2024-09-19T05:40:35.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.352+0000 7f70b259c640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f709406c2b0 0x7f709406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.353+0000 7f70b259c640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f709406c2b0 0x7f709406e770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70a4006fd0 tx=0x7f70a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.357+0000 7f70a2ffd640 1 -- 172.21.15.103:0/2136336693 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f70b414f960 con 0x7f70b4155490 2024-09-19T05:40:35.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.525+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f70b4074520 con 0x7f709406c2b0 2024-09-19T05:40:35.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.525+0000 7f70a2ffd640 1 -- 172.21.15.103:0/2136336693 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f70b4074520 con 0x7f709406c2b0 2024-09-19T05:40:35.528 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T05:40:35.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f709406c2b0 msgr2=0x7f709406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f709406c2b0 0x7f709406e770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70a4006fd0 tx=0x7f70a4008040 comp rx=0 tx=0).stop 2024-09-19T05:40:35.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b4155490 msgr2=0x7f70b40c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b4155490 0x7f70b40c5390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000c00 tx=0x7f70a80046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 shutdown_connections 2024-09-19T05:40:35.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f709406c2b0 0x7f709406e770 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70b41566f0 0x7f70b414b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b4155490 0x7f70b40c5390 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 --2- 172.21.15.103:0/2136336693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70b41550b0 0x7f70b40c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 >> 172.21.15.103:0/2136336693 conn(0x7f70b406c240 msgr2=0x7f70b40ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 shutdown_connections 2024-09-19T05:40:35.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.527+0000 7f70b8d52640 1 -- 172.21.15.103:0/2136336693 wait complete. 2024-09-19T05:40:35.541 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T05:40:35.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:35.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.641+0000 7f6fac1f6640 1 Processor -- start 2024-09-19T05:40:35.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.642+0000 7f6fac1f6640 1 -- start start 2024-09-19T05:40:35.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.642+0000 7f6fac1f6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fa4073f20 0x7f6fa415e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.642+0000 7f6fac1f6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa40ccc50 0x7f6fa415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.642+0000 7f6fac1f6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa40cbf40 con 0x7f6fa41550f0 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.642+0000 7f6fac1f6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa415b0a0 con 0x7f6fa4073f20 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.642+0000 7f6fac1f6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa41554d0 con 0x7f6fa40ccc50 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6fa9791640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fa4073f20 0x7f6fa415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6fa9791640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fa4073f20 0x7f6fa415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39784/0 (socket says 172.21.15.103:39784) 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6fa9791640 1 -- 172.21.15.103:0/908208675 learned_addr learned my addr 172.21.15.103:0/908208675 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6fa9791640 1 -- 172.21.15.103:0/908208675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa40ccc50 msgr2=0x7f6fa415ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6faa793640 1 --2- 172.21.15.103:0/908208675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa40ccc50 0x7f6fa415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6fa9791640 1 --2- 172.21.15.103:0/908208675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa40ccc50 0x7f6fa415ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6fa9791640 1 -- 172.21.15.103:0/908208675 >> v1:172.21.15.174:6789/0 conn(0x7f6fa41550f0 legacy=0x7f6fa40d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6fa9791640 1 -- 172.21.15.103:0/908208675 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa415b360 con 0x7f6fa4073f20 2024-09-19T05:40:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.643+0000 7f6faa793640 1 --2- 172.21.15.103:0/908208675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa40ccc50 0x7f6fa415ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fa9791640 1 --2- 172.21.15.103:0/908208675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa4073f20 0x7f6fa415e540 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009870 tx=0x7f6f9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79df540e82bf153 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fa8f90640 1 -- 172.21.15.103:0/908208675 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94037070 con 0x7f6fa4073f20 2024-09-19T05:40:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fa8f90640 1 -- 172.21.15.103:0/908208675 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f94032440 con 0x7f6fa4073f20 2024-09-19T05:40:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fa8f90640 1 -- 172.21.15.103:0/908208675 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94032810 con 0x7f6fa4073f20 2024-09-19T05:40:35.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fac1f6640 1 -- 172.21.15.103:0/908208675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa4073f20 msgr2=0x7f6fa415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fac1f6640 1 --2- 172.21.15.103:0/908208675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa4073f20 0x7f6fa415e540 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009870 tx=0x7f6f9402a180 comp rx=0 tx=0).stop 2024-09-19T05:40:35.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fac1f6640 1 -- 172.21.15.103:0/908208675 shutdown_connections 2024-09-19T05:40:35.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fac1f6640 1 --2- 172.21.15.103:0/908208675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa40ccc50 0x7f6fa415ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fac1f6640 1 --2- 172.21.15.103:0/908208675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa4073f20 0x7f6fa415e540 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.644+0000 7f6fac1f6640 1 -- 172.21.15.103:0/908208675 >> 172.21.15.103:0/908208675 conn(0x7f6fa406bc10 msgr2=0x7f6fa406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.645+0000 7f6fac1f6640 1 -- 172.21.15.103:0/908208675 shutdown_connections 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.645+0000 7f6fac1f6640 1 -- 172.21.15.103:0/908208675 wait complete. 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.646+0000 7f6fac1f6640 1 Processor -- start 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.646+0000 7f6fac1f6640 1 -- start start 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.646+0000 7f6fac1f6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa4073f20 0x7f6fa4149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fac1f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa40ccc50 0x7f6fa4148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fac1f6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa41550f0 0x7f6fa41494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fac1f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa415bc00 con 0x7f6fa40ccc50 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fac1f6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa415b920 con 0x7f6fa41550f0 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fac1f6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa415ad90 con 0x7f6fa4073f20 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa40ccc50 0x7f6fa4148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa40ccc50 0x7f6fa4148f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39786/0 (socket says 172.21.15.103:39786) 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 -- 172.21.15.103:0/2383020634 learned_addr learned my addr 172.21.15.103:0/2383020634 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6faa793640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa41550f0 0x7f6fa41494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9f92640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa4073f20 0x7f6fa4149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 -- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa4073f20 msgr2=0x7f6fa4149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6fa4073f20 0x7f6fa4149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 -- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa41550f0 msgr2=0x7f6fa41494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa41550f0 0x7f6fa41494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 -- 172.21.15.103:0/2383020634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa40c8ae0 con 0x7f6fa40ccc50 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fa9791640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa40ccc50 0x7f6fa4148f70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f94000c00 tx=0x7f6f940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94037040 con 0x7f6fa40ccc50 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f94042070 con 0x7f6fa40ccc50 2024-09-19T05:40:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa40d0570 con 0x7f6fa40ccc50 2024-09-19T05:40:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94030bb0 con 0x7f6fa40ccc50 2024-09-19T05:40:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.647+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa40c9040 con 0x7f6fa40ccc50 2024-09-19T05:40:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.648+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fa41481b0 con 0x7f6fa40ccc50 2024-09-19T05:40:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.650+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f94047460 con 0x7f6fa40ccc50 2024-09-19T05:40:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.650+0000 7f6f9a7fc640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6f8806c2b0 0x7f6f8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.650+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f6f940ac500 con 0x7f6fa40ccc50 2024-09-19T05:40:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.650+0000 7f6fa9f92640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6f8806c2b0 0x7f6f8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.650+0000 7f6f9a7fc640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f6f88075cc0 0x7f6f88078160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.650+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 --> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f94001d30 con 0x7f6f88075cc0 2024-09-19T05:40:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.650+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f940b3050 con 0x7f6fa40ccc50 2024-09-19T05:40:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.651+0000 7f6faa793640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f6f88075cc0 0x7f6f88078160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.651+0000 7f6fa9f92640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6f8806c2b0 0x7f6f8806e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005520 tx=0x7f6f9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.651+0000 7f6faa793640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f6f88075cc0 0x7f6f88078160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.652+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== osd.5 v2:172.21.15.174:6808/2844736294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f94001d30 con 0x7f6f88075cc0 2024-09-19T05:40:35.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.664+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 --> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fa41592f0 con 0x7f6f88075cc0 2024-09-19T05:40:35.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6f9a7fc640 1 -- 172.21.15.103:0/2383020634 <== osd.5 v2:172.21.15.174:6808/2844736294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6fa41592f0 con 0x7f6f88075cc0 2024-09-19T05:40:35.667 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:35.667 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:35.667 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:35.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f6f88075cc0 msgr2=0x7f6f88078160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.174:6808/2844736294,v1:172.21.15.174:6809/2844736294] conn(0x7f6f88075cc0 0x7f6f88078160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6f8806c2b0 msgr2=0x7f6f8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f6f8806c2b0 0x7f6f8806e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005520 tx=0x7f6f9c009040 comp rx=0 tx=0).stop 2024-09-19T05:40:35.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa40ccc50 msgr2=0x7f6fa4148f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 --2- 172.21.15.103:0/2383020634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fa40ccc50 0x7f6fa4148f70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f94000c00 tx=0x7f6f940046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6faa793640 1 -- 172.21.15.103:0/2383020634 reap_dead start 2024-09-19T05:40:35.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 shutdown_connections 2024-09-19T05:40:35.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 >> 172.21.15.103:0/2383020634 conn(0x7f6fa406bc10 msgr2=0x7f6fa415e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 shutdown_connections 2024-09-19T05:40:35.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.665+0000 7f6fac1f6640 1 -- 172.21.15.103:0/2383020634 wait complete. 2024-09-19T05:40:35.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T05:40:35.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.774+0000 7f89251d8640 1 Processor -- start 2024-09-19T05:40:35.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.774+0000 7f89251d8640 1 -- start start 2024-09-19T05:40:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f89251d8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f8920073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f89251d8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f892006d730 0x7f89200ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f89251d8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89200c9d00 con 0x7f8920155490 2024-09-19T05:40:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f89251d8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f892015edb0 con 0x7f892006d730 2024-09-19T05:40:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f89251d8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f892015e4a0 con 0x7f89201550b0 2024-09-19T05:40:35.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f8917fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f892006d730 0x7f89200ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f891f59e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8920155490 0x7f89200ce6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35074/0 (socket says 172.21.15.103:35074) 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f8917fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f892006d730 0x7f89200ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39796/0 (socket says 172.21.15.103:39796) 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f891f59e640 1 -- 172.21.15.103:0/3038329963 learned_addr learned my addr 172.21.15.103:0/3038329963 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f891ed9d640 1 --2- 172.21.15.103:0/3038329963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f8920073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f8917fff640 1 -- 172.21.15.103:0/3038329963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 msgr2=0x7f8920073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f8917fff640 1 --2- 172.21.15.103:0/3038329963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f8920073f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f8917fff640 1 -- 172.21.15.103:0/3038329963 >> v1:172.21.15.103:6789/0 conn(0x7f8920155490 legacy=0x7f89200ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.775+0000 7f8917fff640 1 -- 172.21.15.103:0/3038329963 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89200c9fc0 con 0x7f892006d730 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.776+0000 7f8917fff640 1 --2- 172.21.15.103:0/3038329963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f892006d730 0x7f89200ca2a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89080097a0 tx=0x7f890802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c355eff374673e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.776+0000 7f891e59c640 1 -- 172.21.15.103:0/3038329963 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908037070 con 0x7f892006d730 2024-09-19T05:40:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.776+0000 7f891e59c640 1 -- 172.21.15.103:0/3038329963 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8908032440 con 0x7f892006d730 2024-09-19T05:40:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.776+0000 7f891e59c640 1 -- 172.21.15.103:0/3038329963 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908032810 con 0x7f892006d730 2024-09-19T05:40:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 -- 172.21.15.103:0/3038329963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f892006d730 msgr2=0x7f89200ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 --2- 172.21.15.103:0/3038329963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f892006d730 0x7f89200ca2a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89080097a0 tx=0x7f890802a210 comp rx=0 tx=0).stop 2024-09-19T05:40:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 -- 172.21.15.103:0/3038329963 shutdown_connections 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 --2- 172.21.15.103:0/3038329963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f892006d730 0x7f89200ca2a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 --2- 172.21.15.103:0/3038329963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f8920073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 -- 172.21.15.103:0/3038329963 >> 172.21.15.103:0/3038329963 conn(0x7f892006c240 msgr2=0x7f8920067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 -- 172.21.15.103:0/3038329963 shutdown_connections 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.777+0000 7f89251d8640 1 -- 172.21.15.103:0/3038329963 wait complete. 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.778+0000 7f89251d8640 1 Processor -- start 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.778+0000 7f89251d8640 1 -- start start 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89251d8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f892015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89251d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8920155490 0x7f89200c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89251d8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89201523b0 0x7f89200c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89251d8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f892015f240 con 0x7f8920155490 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89251d8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f892015ea40 con 0x7f89201523b0 2024-09-19T05:40:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89251d8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f892015dce0 con 0x7f89201550b0 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8920155490 0x7f89200c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8920155490 0x7f89200c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39804/0 (socket says 172.21.15.103:39804) 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 -- 172.21.15.103:0/2777466345 learned_addr learned my addr 172.21.15.103:0/2777466345 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f891f59e640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89201523b0 0x7f89200c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f891ed9d640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f892015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 -- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 msgr2=0x7f892015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f892015d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 -- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89201523b0 msgr2=0x7f89200c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89201523b0 0x7f89200c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 -- 172.21.15.103:0/2777466345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8920157d70 con 0x7f8920155490 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f8917fff640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8920155490 0x7f89200c48d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8908035040 tx=0x7f89080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89177fe640 1 -- 172.21.15.103:0/2777466345 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908037040 con 0x7f8920155490 2024-09-19T05:40:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89177fe640 1 -- 172.21.15.103:0/2777466345 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8908030770 con 0x7f8920155490 2024-09-19T05:40:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89177fe640 1 -- 172.21.15.103:0/2777466345 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908030b80 con 0x7f8920155490 2024-09-19T05:40:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.779+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8920157ff0 con 0x7f8920155490 2024-09-19T05:40:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.780+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89201585b0 con 0x7f8920155490 2024-09-19T05:40:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.781+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8920074520 con 0x7f8920155490 2024-09-19T05:40:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.781+0000 7f89177fe640 1 -- 172.21.15.103:0/2777466345 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8908044020 con 0x7f8920155490 2024-09-19T05:40:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.781+0000 7f89177fe640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f890006c2b0 0x7f890006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.782+0000 7f891ed9d640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f890006c2b0 0x7f890006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.782+0000 7f89177fe640 1 -- 172.21.15.103:0/2777466345 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f89080abce0 con 0x7f8920155490 2024-09-19T05:40:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.782+0000 7f891ed9d640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f890006c2b0 0x7f890006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8910006fd0 tx=0x7f8910008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.786+0000 7f89177fe640 1 -- 172.21.15.103:0/2777466345 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8920157d70 con 0x7f8920155490 2024-09-19T05:40:35.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.954+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f89200c9710 con 0x7f890006c2b0 2024-09-19T05:40:35.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.954+0000 7f89177fe640 1 -- 172.21.15.103:0/2777466345 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89200c9710 con 0x7f890006c2b0 2024-09-19T05:40:35.957 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f890006c2b0 msgr2=0x7f890006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f890006c2b0 0x7f890006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8910006fd0 tx=0x7f8910008040 comp rx=0 tx=0).stop 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8920155490 msgr2=0x7f89200c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8920155490 0x7f89200c48d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8908035040 tx=0x7f89080046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 shutdown_connections 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f890006c2b0 0x7f890006e770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89201523b0 0x7f89200c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8920155490 0x7f89200c48d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 --2- 172.21.15.103:0/2777466345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89201550b0 0x7f892015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:35.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 >> 172.21.15.103:0/2777466345 conn(0x7f892006c240 msgr2=0x7f89201513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:35.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 shutdown_connections 2024-09-19T05:40:35.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:35.956+0000 7f89251d8640 1 -- 172.21.15.103:0/2777466345 wait complete. 2024-09-19T05:40:35.970 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T05:40:35.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:36.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.069+0000 7fdc5f6e4640 1 Processor -- start 2024-09-19T05:40:36.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.069+0000 7fdc5f6e4640 1 -- start start 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc5f6e4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 0x7fdc580c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc5f6e4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc580c7c10 con 0x7fdc580c66a0 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc5f6e4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc58071840 con 0x7fdc580c62c0 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc5f6e4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdc58071b20 con 0x7fdc58152f00 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc5cc7f640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdc580c66a0 0x7fdc581527f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35086/0 (socket says 172.21.15.103:35086) 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc5cc7f640 1 -- 172.21.15.103:0/224643522 learned_addr learned my addr 172.21.15.103:0/224643522 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc5dc81640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 0x7fdc580c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192419316 0 0) 0x7fdc580c7c10 con 0x7fdc580c66a0 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc44003520 con 0x7fdc580c66a0 2024-09-19T05:40:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3914107118 0 0) 0x7fdc44003520 con 0x7fdc580c66a0 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 msgr2=0x7fdc580c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 0x7fdc580c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 >> v1:172.21.15.174:6789/0 conn(0x7fdc580c62c0 legacy=0x7fdc580730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc58071e00 con 0x7fdc580c66a0 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fdc48001670 con 0x7fdc580c66a0 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 >> v1:172.21.15.103:6789/0 conn(0x7fdc580c66a0 legacy=0x7fdc581527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc440039e0 0x7fdc44003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc44004800 0x7fdc44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 0x7fdc44005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58071b20 con 0x7fdc440039e0 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4400baf0 con 0x7fdc44004800 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.070+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4400bcf0 con 0x7fdc58152f00 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5d480640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc440039e0 0x7fdc44003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5cc7f640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc44004800 0x7fdc44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5dc81640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 0x7fdc44005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5d480640 1 -- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 msgr2=0x7fdc44005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5d480640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 0x7fdc44005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5d480640 1 -- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc44004800 msgr2=0x7fdc44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5d480640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc44004800 0x7fdc44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5d480640 1 -- 172.21.15.103:0/224643522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc44003520 con 0x7fdc440039e0 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5cc7f640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc44004800 0x7fdc44004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5dc81640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc58152f00 0x7fdc44005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.071+0000 7fdc5d480640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc440039e0 0x7fdc44003e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdc54001750 tx=0x7fdc44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2d808a8df148b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc54001370 con 0x7fdc440039e0 2024-09-19T05:40:36.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc540052d0 con 0x7fdc440039e0 2024-09-19T05:40:36.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc4ffff640 1 -- 172.21.15.103:0/224643522 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5402abe0 con 0x7fdc440039e0 2024-09-19T05:40:36.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/224643522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc440039e0 msgr2=0x7fdc44003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc5f6e4640 1 --2- 172.21.15.103:0/224643522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc440039e0 0x7fdc44003e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdc54001750 tx=0x7fdc44005830 comp rx=0 tx=0).stop 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc5dc81640 1 -- 172.21.15.103:0/224643522 reap_dead start 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/224643522 shutdown_connections 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/224643522 >> 172.21.15.103:0/224643522 conn(0x7fdc5806bc10 msgr2=0x7fdc5806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/224643522 shutdown_connections 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.072+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/224643522 wait complete. 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.073+0000 7fdc5f6e4640 1 Processor -- start 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.073+0000 7fdc5f6e4640 1 -- start start 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5f6e4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc440039e0 0x7fdc581e43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5f6e4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5815cdf0 0x7fdc580c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5f6e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc580c5530 0x7fdc581450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5f6e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580c3710 con 0x7fdc580c5530 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5f6e4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58072440 con 0x7fdc5815cdf0 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5f6e4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdc580c3890 con 0x7fdc440039e0 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5dc81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc580c5530 0x7fdc581450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5dc81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc580c5530 0x7fdc581450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39826/0 (socket says 172.21.15.103:39826) 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5dc81640 1 -- 172.21.15.103:0/1430182149 learned_addr learned my addr 172.21.15.103:0/1430182149 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5cc7f640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5815cdf0 0x7fdc580c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.074+0000 7fdc5d480640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc440039e0 0x7fdc581e43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5dc81640 1 -- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc440039e0 msgr2=0x7fdc581e43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5dc81640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc440039e0 0x7fdc581e43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5dc81640 1 -- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5815cdf0 msgr2=0x7fdc580c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5dc81640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5815cdf0 0x7fdc580c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5dc81640 1 -- 172.21.15.103:0/1430182149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc581e2be0 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5dc81640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc580c5530 0x7fdc581450f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdc44004780 tx=0x7fdc50009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50010e50 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc50003990 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc580c9aa0 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50003dc0 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.075+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc580cba90 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.076+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc580c7520 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.076+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc50005d10 con 0x7fdc580c5530 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc4dffb640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdc3c06c2b0 0x7fdc3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdc5008c030 con 0x7fdc580c5530 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc5d480640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdc3c06c2b0 0x7fdc3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc4dffb640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fdc3c075cc0 0x7fdc3c078160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 --> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc3c078830 con 0x7fdc3c075cc0 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc50093050 con 0x7fdc580c5530 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc5cc7f640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fdc3c075cc0 0x7fdc3c078160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.077+0000 7fdc5d480640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdc3c06c2b0 0x7fdc3c06e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc54032000 tx=0x7fdc5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.078+0000 7fdc5cc7f640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fdc3c075cc0 0x7fdc3c078160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.078+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== osd.6 v2:172.21.15.174:6816/2338063485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc3c078830 con 0x7fdc3c075cc0 2024-09-19T05:40:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 --> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdc580c32e0 con 0x7fdc3c075cc0 2024-09-19T05:40:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc4dffb640 1 -- 172.21.15.103:0/1430182149 <== osd.6 v2:172.21.15.174:6816/2338063485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdc580c32e0 con 0x7fdc3c075cc0 2024-09-19T05:40:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:36.094 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fdc3c075cc0 msgr2=0x7fdc3c078160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.174:6816/2338063485,v1:172.21.15.174:6817/2338063485] conn(0x7fdc3c075cc0 0x7fdc3c078160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdc3c06c2b0 msgr2=0x7fdc3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fdc3c06c2b0 0x7fdc3c06e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc54032000 tx=0x7fdc5402e000 comp rx=0 tx=0).stop 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc580c5530 msgr2=0x7fdc581450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 --2- 172.21.15.103:0/1430182149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc580c5530 0x7fdc581450f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdc44004780 tx=0x7fdc50009f90 comp rx=0 tx=0).stop 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5dc81640 1 -- 172.21.15.103:0/1430182149 reap_dead start 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 shutdown_connections 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 >> 172.21.15.103:0/1430182149 conn(0x7fdc5806bc10 msgr2=0x7fdc581525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 shutdown_connections 2024-09-19T05:40:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.092+0000 7fdc5f6e4640 1 -- 172.21.15.103:0/1430182149 wait complete. 2024-09-19T05:40:36.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T05:40:36.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.202+0000 7fc1fa56d640 1 Processor -- start 2024-09-19T05:40:36.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.202+0000 7fc1fa56d640 1 -- start start 2024-09-19T05:40:36.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1fa56d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc1f41552f0 0x7fc1f40c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1fa56d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f40c7970 0x7fc1f415b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1fa56d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f40b3350 con 0x7fc1f415b9d0 2024-09-19T05:40:36.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1fa56d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f40b2e20 con 0x7fc1f41552f0 2024-09-19T05:40:36.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1fa56d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f40c8d30 con 0x7fc1f40c7970 2024-09-19T05:40:36.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1f8b0a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc1f415b9d0 0x7fc1f40c8f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35096/0 (socket says 172.21.15.103:35096) 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1f8b0a640 1 -- 172.21.15.103:0/1059360033 learned_addr learned my addr 172.21.15.103:0/1059360033 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1f3fff640 1 --2- 172.21.15.103:0/1059360033 >> v2:172.21.15.174:3300/0 conn(0x7fc1f41552f0 0x7fc1f40c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1f37fe640 1 --2- 172.21.15.103:0/1059360033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f40c7970 0x7fc1f415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1f2ffd640 1 -- 172.21.15.103:0/1059360033 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905979478 0 0) 0x7fc1f40b3350 con 0x7fc1f415b9d0 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.203+0000 7fc1f2ffd640 1 -- 172.21.15.103:0/1059360033 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1dc003520 con 0x7fc1f415b9d0 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.204+0000 7fc1f37fe640 1 -- 172.21.15.103:0/1059360033 >> v2:172.21.15.174:3300/0 conn(0x7fc1f41552f0 msgr2=0x7fc1f40c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.204+0000 7fc1f2ffd640 1 -- 172.21.15.103:0/1059360033 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1553097642 0 0) 0x7fc1dc003520 con 0x7fc1f415b9d0 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.204+0000 7fc1f37fe640 1 --2- 172.21.15.103:0/1059360033 >> v2:172.21.15.174:3300/0 conn(0x7fc1f41552f0 0x7fc1f40c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.204+0000 7fc1f37fe640 1 -- 172.21.15.103:0/1059360033 >> v1:172.21.15.103:6789/0 conn(0x7fc1f415b9d0 legacy=0x7fc1f40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.204+0000 7fc1f37fe640 1 -- 172.21.15.103:0/1059360033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f40b3070 con 0x7fc1f40c7970 2024-09-19T05:40:36.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.204+0000 7fc1f3fff640 1 --2- 172.21.15.103:0/1059360033 >> v2:172.21.15.174:3300/0 conn(0x7fc1f41552f0 0x7fc1f40c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.204+0000 7fc1f37fe640 1 --2- 172.21.15.103:0/1059360033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f40c7970 0x7fc1f415b490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80097a0 tx=0x7fc1e802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efb5f6eb67fd4ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1f2ffd640 1 -- 172.21.15.103:0/1059360033 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8037070 con 0x7fc1f40c7970 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1f2ffd640 1 -- 172.21.15.103:0/1059360033 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e802aba0 con 0x7fc1f40c7970 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1f2ffd640 1 -- 172.21.15.103:0/1059360033 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0019f0 con 0x7fc1f40c7970 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1059360033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f40c7970 msgr2=0x7fc1f415b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1059360033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f40c7970 0x7fc1f415b490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80097a0 tx=0x7fc1e802a110 comp rx=0 tx=0).stop 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1059360033 shutdown_connections 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1059360033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f40c7970 0x7fc1f415b490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1059360033 >> v2:172.21.15.174:3300/0 conn(0x7fc1f41552f0 0x7fc1f40c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1059360033 >> 172.21.15.103:0/1059360033 conn(0x7fc1f40c9a70 msgr2=0x7fc1f40c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1059360033 shutdown_connections 2024-09-19T05:40:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.205+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1059360033 wait complete. 2024-09-19T05:40:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.206+0000 7fc1fa56d640 1 Processor -- start 2024-09-19T05:40:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.206+0000 7fc1fa56d640 1 -- start start 2024-09-19T05:40:36.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1fa56d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f40c7970 0x7fc1f4159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1fa56d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1f41552f0 0x7fc1f4073540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1fa56d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f415b9d0 0x7fc1f41e6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1fa56d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f415af70 con 0x7fc1f41552f0 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1fa56d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40c8a50 con 0x7fc1f40c7970 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1fa56d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f40c7e80 con 0x7fc1f415b9d0 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1f41552f0 0x7fc1f4073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1f41552f0 0x7fc1f4073540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39834/0 (socket says 172.21.15.103:39834) 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.207+0000 7fc1f37fe640 1 -- 172.21.15.103:0/1549250975 learned_addr learned my addr 172.21.15.103:0/1549250975 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f8b0a640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f415b9d0 0x7fc1f41e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f3fff640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f40c7970 0x7fc1f4159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f37fe640 1 -- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f415b9d0 msgr2=0x7fc1f41e6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f37fe640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f415b9d0 0x7fc1f41e6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f37fe640 1 -- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f40c7970 msgr2=0x7fc1f4159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f37fe640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f40c7970 0x7fc1f4159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f37fe640 1 -- 172.21.15.103:0/1549250975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f415acc0 con 0x7fc1f41552f0 2024-09-19T05:40:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f37fe640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1f41552f0 0x7fc1f4073540 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8035040 tx=0x7fc1e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f0ff9640 1 -- 172.21.15.103:0/1549250975 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8037050 con 0x7fc1f41552f0 2024-09-19T05:40:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f414d3e0 con 0x7fc1f41552f0 2024-09-19T05:40:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f0ff9640 1 -- 172.21.15.103:0/1549250975 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e8043070 con 0x7fc1f41552f0 2024-09-19T05:40:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1f0ff9640 1 -- 172.21.15.103:0/1549250975 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8006e10 con 0x7fc1f41552f0 2024-09-19T05:40:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.208+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f41e5290 con 0x7fc1f41552f0 2024-09-19T05:40:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.209+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f40693d0 con 0x7fc1f41552f0 2024-09-19T05:40:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.209+0000 7fc1f0ff9640 1 -- 172.21.15.103:0/1549250975 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc1e803ca10 con 0x7fc1f41552f0 2024-09-19T05:40:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.210+0000 7fc1f0ff9640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc1e006c2e0 0x7fc1e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.210+0000 7fc1f0ff9640 1 -- 172.21.15.103:0/1549250975 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc1e80ac350 con 0x7fc1f41552f0 2024-09-19T05:40:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.210+0000 7fc1f3fff640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc1e006c2e0 0x7fc1e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.210+0000 7fc1f3fff640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc1e006c2e0 0x7fc1e006e7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009950 tx=0x7fc1e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.214+0000 7fc1f0ff9640 1 -- 172.21.15.103:0/1549250975 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc1e807a760 con 0x7fc1f41552f0 2024-09-19T05:40:36.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.384+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc1f415b490 con 0x7fc1e006c2e0 2024-09-19T05:40:36.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.384+0000 7fc1f0ff9640 1 -- 172.21.15.103:0/1549250975 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc1f415b490 con 0x7fc1e006c2e0 2024-09-19T05:40:36.387 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T05:40:36.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.386+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc1e006c2e0 msgr2=0x7fc1e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.386+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc1e006c2e0 0x7fc1e006e7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009950 tx=0x7fc1e4008040 comp rx=0 tx=0).stop 2024-09-19T05:40:36.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1f41552f0 msgr2=0x7fc1f4073540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1f41552f0 0x7fc1f4073540 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8035040 tx=0x7fc1e80046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 shutdown_connections 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc1e006c2e0 0x7fc1e006e7a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f415b9d0 0x7fc1f41e6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1f41552f0 0x7fc1f4073540 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 --2- 172.21.15.103:0/1549250975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1f40c7970 0x7fc1f4159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 >> 172.21.15.103:0/1549250975 conn(0x7fc1f40c9a70 msgr2=0x7fc1f40c8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 shutdown_connections 2024-09-19T05:40:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.387+0000 7fc1fa56d640 1 -- 172.21.15.103:0/1549250975 wait complete. 2024-09-19T05:40:36.400 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T05:40:36.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T05:40:36.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.502+0000 7f2629274640 1 Processor -- start 2024-09-19T05:40:36.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.502+0000 7f2629274640 1 -- start start 2024-09-19T05:40:36.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2629274640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2624152d40 0x7f2624158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2629274640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26240cf490 0x7f26240c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2629274640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26240c61e0 con 0x7f2624073fb0 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2629274640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f26240c6a80 con 0x7f2624152d40 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2629274640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f26240c64c0 con 0x7f26240cf490 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2622ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2624152d40 0x7f2624158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2622ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2624152d40 0x7f2624158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39836/0 (socket says 172.21.15.103:39836) 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2622ffd640 1 -- 172.21.15.103:0/529093819 learned_addr learned my addr 172.21.15.103:0/529093819 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f26227fc640 1 --2- 172.21.15.103:0/529093819 >> v2:172.21.15.174:3300/0 conn(0x7f26240cf490 0x7f26240c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2622ffd640 1 -- 172.21.15.103:0/529093819 >> v2:172.21.15.174:3300/0 conn(0x7f26240cf490 msgr2=0x7f26240c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2622ffd640 1 --2- 172.21.15.103:0/529093819 >> v2:172.21.15.174:3300/0 conn(0x7f26240cf490 0x7f26240c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2622ffd640 1 -- 172.21.15.103:0/529093819 >> v1:172.21.15.103:6789/0 conn(0x7f2624073fb0 legacy=0x7f26240c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f2622ffd640 1 -- 172.21.15.103:0/529093819 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26240c67a0 con 0x7f2624152d40 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.503+0000 7f26227fc640 1 --2- 172.21.15.103:0/529093819 >> v2:172.21.15.174:3300/0 conn(0x7f26240cf490 0x7f26240c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:36.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.504+0000 7f2622ffd640 1 --2- 172.21.15.103:0/529093819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624158bc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f26240c6c00 tx=0x7f261402a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce00603a3d5ce28f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.504+0000 7f2621ffb640 1 -- 172.21.15.103:0/529093819 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614036070 con 0x7f2624152d40 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.504+0000 7f2621ffb640 1 -- 172.21.15.103:0/529093819 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2614031600 con 0x7f2624152d40 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.504+0000 7f2621ffb640 1 -- 172.21.15.103:0/529093819 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26140319d0 con 0x7f2624152d40 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 -- 172.21.15.103:0/529093819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 msgr2=0x7f2624158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 --2- 172.21.15.103:0/529093819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624158bc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f26240c6c00 tx=0x7f261402a7e0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 -- 172.21.15.103:0/529093819 shutdown_connections 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 --2- 172.21.15.103:0/529093819 >> v2:172.21.15.174:3300/0 conn(0x7f26240cf490 0x7f26240c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 --2- 172.21.15.103:0/529093819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624158bc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 -- 172.21.15.103:0/529093819 >> 172.21.15.103:0/529093819 conn(0x7f26240ce8c0 msgr2=0x7f26240cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 -- 172.21.15.103:0/529093819 shutdown_connections 2024-09-19T05:40:36.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.505+0000 7f2629274640 1 -- 172.21.15.103:0/529093819 wait complete. 2024-09-19T05:40:36.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.506+0000 7f2629274640 1 Processor -- start 2024-09-19T05:40:36.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.506+0000 7f2629274640 1 -- start start 2024-09-19T05:40:36.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2629274640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2624073fb0 0x7f26241f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2629274640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26240cf490 0x7f2624153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2629274640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2629274640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26240c5950 con 0x7f2624152d40 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2629274640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f26240c8430 con 0x7f26240cf490 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2629274640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f26240c5ad0 con 0x7f2624073fb0 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39852/0 (socket says 172.21.15.103:39852) 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 -- 172.21.15.103:0/4291576609 learned_addr learned my addr 172.21.15.103:0/4291576609 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26227fc640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26240cf490 0x7f2624153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2622ffd640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2624073fb0 0x7f26241f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 -- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2624073fb0 msgr2=0x7f26241f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2624073fb0 0x7f26241f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 -- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26240cf490 msgr2=0x7f2624153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26240cf490 0x7f2624153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 -- 172.21.15.103:0/4291576609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26241eeb70 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f2622ffd640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2624073fb0 0x7f26241f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26227fc640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26240cf490 0x7f2624153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.507+0000 7f26237fe640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624070f60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c400 tx=0x7f261c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.508+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c017070 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.508+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c0052d0 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.508+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26241f2fe0 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.508+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c003810 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.508+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f262415cf30 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.509+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26240c6c00 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.509+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f261c01a070 con 0x7f2624152d40 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f261b7fe640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f260406c2b0 0x7f260406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f261c08ab00 con 0x7f2624152d40 2024-09-19T05:40:36.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f2622ffd640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f260406c2b0 0x7f260406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f261b7fe640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f2604075cc0 0x7f2604078160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 --> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f261c015e70 con 0x7f2604075cc0 2024-09-19T05:40:36.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f261c08f2c0 con 0x7f2624152d40 2024-09-19T05:40:36.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f2622ffd640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f260406c2b0 0x7f260406e770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2614033000 tx=0x7f2614009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.510+0000 7f26227fc640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f2604075cc0 0x7f2604078160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.511+0000 7f26227fc640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f2604075cc0 0x7f2604078160 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.511+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== osd.7 v2:172.21.15.174:6800/3833416163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f261c015e70 con 0x7f2604075cc0 2024-09-19T05:40:36.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.524+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 --> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2624071c90 con 0x7f2604075cc0 2024-09-19T05:40:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.524+0000 7f261b7fe640 1 -- 172.21.15.103:0/4291576609 <== osd.7 v2:172.21.15.174:6800/3833416163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2624071c90 con 0x7f2604075cc0 2024-09-19T05:40:36.527 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-19T05:40:36.527 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T05:40:36.527 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-19T05:40:36.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f2604075cc0 msgr2=0x7f2604078160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.174:6800/3833416163,v1:172.21.15.174:6801/3833416163] conn(0x7f2604075cc0 0x7f2604078160 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f260406c2b0 msgr2=0x7f260406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f260406c2b0 0x7f260406e770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2614033000 tx=0x7f2614009000 comp rx=0 tx=0).stop 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 msgr2=0x7f2624070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 --2- 172.21.15.103:0/4291576609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2624152d40 0x7f2624070f60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c400 tx=0x7f261c00c8c0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f26237fe640 1 -- 172.21.15.103:0/4291576609 reap_dead start 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 shutdown_connections 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 >> 172.21.15.103:0/4291576609 conn(0x7f26240ce8c0 msgr2=0x7f26240c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 shutdown_connections 2024-09-19T05:40:36.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.525+0000 7f2629274640 1 -- 172.21.15.103:0/4291576609 wait complete. 2024-09-19T05:40:36.538 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T05:40:36.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.637+0000 7f3c6ef81640 1 Processor -- start 2024-09-19T05:40:36.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.637+0000 7f3c6ef81640 1 -- start start 2024-09-19T05:40:36.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c6ef81640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3c68155490 0x7f3c68073f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c6ef81640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c680c9d00 con 0x7f3c6806d730 2024-09-19T05:40:36.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c6ef81640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6815e4a0 con 0x7f3c681550b0 2024-09-19T05:40:36.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c6ef81640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3c6815edb0 con 0x7f3c68155490 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c67fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3c6806d730 0x7f3c680ce6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35108/0 (socket says 172.21.15.103:35108) 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c67fff640 1 -- 172.21.15.103:0/3961618903 learned_addr learned my addr 172.21.15.103:0/3961618903 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127462071 0 0) 0x7f3c680c9d00 con 0x7f3c6806d730 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c50003520 con 0x7f3c6806d730 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c6d51e640 1 --2- 172.21.15.103:0/3961618903 >> v2:172.21.15.174:3300/0 conn(0x7f3c68155490 0x7f3c68073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 918221838 0 0) 0x7f3c50003520 con 0x7f3c6806d730 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.638+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 >> v2:172.21.15.174:3300/0 conn(0x7f3c68155490 msgr2=0x7f3c68073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 --2- 172.21.15.103:0/3961618903 >> v2:172.21.15.174:3300/0 conn(0x7f3c68155490 0x7f3c68073f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 >> v1:172.21.15.174:6789/0 conn(0x7f3c681550b0 legacy=0x7f3c680ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c680c9fc0 con 0x7f3c6806d730 2024-09-19T05:40:36.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f3c5c001670 con 0x7f3c6806d730 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 >> v1:172.21.15.103:6789/0 conn(0x7f3c6806d730 legacy=0x7f3c680ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c500039b0 0x7f3c50003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50004800 0x7f3c50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c50005210 0x7f3c5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6815edb0 con 0x7f3c50005210 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5000c120 con 0x7f3c50004800 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5000c320 con 0x7f3c500039b0 2024-09-19T05:40:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c6d51e640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c50005210 0x7f3c5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c67fff640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50004800 0x7f3c50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c6cd1d640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c500039b0 0x7f3c50003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c6d51e640 1 -- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c500039b0 msgr2=0x7f3c50003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c6d51e640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c500039b0 0x7f3c50003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c6d51e640 1 -- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50004800 msgr2=0x7f3c50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c6d51e640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50004800 0x7f3c50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.639+0000 7f3c6d51e640 1 -- 172.21.15.103:0/3961618903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c50003520 con 0x7f3c50005210 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c6d51e640 1 -- 172.21.15.103:0/3961618903 reap_dead start 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c6d51e640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c50005210 0x7f3c5000b9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3c60007330 tx=0x7f3c50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c91525e7f848a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60009be0 con 0x7f3c50005210 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c60036600 con 0x7f3c50005210 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c677fe640 1 -- 172.21.15.103:0/3961618903 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c600369d0 con 0x7f3c50005210 2024-09-19T05:40:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3961618903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c50005210 msgr2=0x7f3c5000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c50005210 0x7f3c5000b9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3c60007330 tx=0x7f3c50005830 comp rx=0 tx=0).stop 2024-09-19T05:40:36.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3961618903 shutdown_connections 2024-09-19T05:40:36.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3961618903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c50005210 0x7f3c5000b9c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.640+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3961618903 >> 172.21.15.103:0/3961618903 conn(0x7f3c6806c240 msgr2=0x7f3c68067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.641+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3961618903 shutdown_connections 2024-09-19T05:40:36.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.641+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3961618903 wait complete. 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.642+0000 7f3c6ef81640 1 Processor -- start 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.642+0000 7f3c6ef81640 1 -- start start 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.642+0000 7f3c6ef81640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50005210 0x7f3c681f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6ef81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6814e4d0 0x7f3c68152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6ef81640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c68156a50 0x7f3c6814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6ef81640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6815f240 con 0x7f3c6814e4d0 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6ef81640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6815ea40 con 0x7f3c50005210 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6ef81640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3c681f5360 con 0x7f3c68156a50 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6814e4d0 0x7f3c68152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6814e4d0 0x7f3c68152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39870/0 (socket says 172.21.15.103:39870) 2024-09-19T05:40:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 -- 172.21.15.103:0/3276123600 learned_addr learned my addr 172.21.15.103:0/3276123600 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6cd1d640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50005210 0x7f3c681f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6d51e640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c68156a50 0x7f3c6814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 -- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c68156a50 msgr2=0x7f3c6814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c68156a50 0x7f3c6814b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 -- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50005210 msgr2=0x7f3c681f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50005210 0x7f3c681f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 -- 172.21.15.103:0/3276123600 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6814ea10 con 0x7f3c6814e4d0 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6cd1d640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50005210 0x7f3c681f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c67fff640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6814e4d0 0x7f3c68152cb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007340 tx=0x7f3c5c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c657fa640 1 -- 172.21.15.103:0/3276123600 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00f860 con 0x7f3c6814e4d0 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c657fa640 1 -- 172.21.15.103:0/3276123600 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c5c018070 con 0x7f3c6814e4d0 2024-09-19T05:40:36.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6814ecb0 con 0x7f3c6814e4d0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c657fa640 1 -- 172.21.15.103:0/3276123600 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00fc40 con 0x7f3c6814e4d0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.643+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6814d160 con 0x7f3c6814e4d0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.644+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6806db20 con 0x7f3c6814e4d0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.645+0000 7f3c657fa640 1 -- 172.21.15.103:0/3276123600 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3c5c01d460 con 0x7f3c6814e4d0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.645+0000 7f3c657fa640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3c5406c2b0 0x7f3c5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.645+0000 7f3c657fa640 1 -- 172.21.15.103:0/3276123600 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3c5c08b930 con 0x7f3c6814e4d0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.645+0000 7f3c6cd1d640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3c5406c2b0 0x7f3c5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.646+0000 7f3c6cd1d640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3c5406c2b0 0x7f3c5406e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.649+0000 7f3c657fa640 1 -- 172.21.15.103:0/3276123600 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3c6806db20 con 0x7f3c6814e4d0 2024-09-19T05:40:36.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.816+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f3c68074520 con 0x7f3c5406c2b0 2024-09-19T05:40:36.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.817+0000 7f3c657fa640 1 -- 172.21.15.103:0/3276123600 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3c68074520 con 0x7f3c5406c2b0 2024-09-19T05:40:36.820 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T05:40:36.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3c5406c2b0 msgr2=0x7f3c5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3c5406c2b0 0x7f3c5406e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58009040 comp rx=0 tx=0).stop 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6814e4d0 msgr2=0x7f3c68152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6814e4d0 0x7f3c68152cb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007340 tx=0x7f3c5c007800 comp rx=0 tx=0).stop 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 shutdown_connections 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f3c5406c2b0 0x7f3c5406e770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c68156a50 0x7f3c6814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6814e4d0 0x7f3c68152cb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 --2- 172.21.15.103:0/3276123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c50005210 0x7f3c681f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 >> 172.21.15.103:0/3276123600 conn(0x7f3c6806c240 msgr2=0x7f3c680ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 shutdown_connections 2024-09-19T05:40:36.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.820+0000 7f3c6ef81640 1 -- 172.21.15.103:0/3276123600 wait complete. 2024-09-19T05:40:36.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.929+0000 7f67b64b7640 1 Processor -- start 2024-09-19T05:40:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.929+0000 7f67b64b7640 1 -- start start 2024-09-19T05:40:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b64b7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b0072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b64b7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67b0068790 0x7f67b00729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b64b7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67b0070bc0 0x7f67b0143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b64b7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f67b01446f0 con 0x7f67b0068790 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b64b7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f67b01441c0 con 0x7f67b0070bc0 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b64b7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f67b006cab0 con 0x7f67b006be80 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67b0068790 0x7f67b00729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67b0068790 0x7f67b00729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39878/0 (socket says 172.21.15.103:39878) 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 -- 172.21.15.103:0/2852308104 learned_addr learned my addr 172.21.15.103:0/2852308104 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b4a54640 1 --2- 172.21.15.103:0/2852308104 >> v2:172.21.15.174:3300/0 conn(0x7f67b0070bc0 0x7f67b0143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67affff640 1 --2- 172.21.15.103:0/2852308104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b0072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 -- 172.21.15.103:0/2852308104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 msgr2=0x7f67b0072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 --2- 172.21.15.103:0/2852308104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b0072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 -- 172.21.15.103:0/2852308104 >> v2:172.21.15.174:3300/0 conn(0x7f67b0070bc0 msgr2=0x7f67b0143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 --2- 172.21.15.103:0/2852308104 >> v2:172.21.15.174:3300/0 conn(0x7f67b0070bc0 0x7f67b0143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67af7fe640 1 -- 172.21.15.103:0/2852308104 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b0143ee0 con 0x7f67b0068790 2024-09-19T05:40:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.930+0000 7f67b4a54640 1 --2- 172.21.15.103:0/2852308104 >> v2:172.21.15.174:3300/0 conn(0x7f67b0070bc0 0x7f67b0143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.931+0000 7f67af7fe640 1 --2- 172.21.15.103:0/2852308104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0068790 0x7f67b00729c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f67b00c49f0 tx=0x7f679802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabd03a4b3845007 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.931+0000 7f67aeffd640 1 -- 172.21.15.103:0/2852308104 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798037070 con 0x7f67b0068790 2024-09-19T05:40:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.931+0000 7f67aeffd640 1 -- 172.21.15.103:0/2852308104 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6798032440 con 0x7f67b0068790 2024-09-19T05:40:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.931+0000 7f67aeffd640 1 -- 172.21.15.103:0/2852308104 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798032810 con 0x7f67b0068790 2024-09-19T05:40:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 -- 172.21.15.103:0/2852308104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0068790 msgr2=0x7f67b00729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 --2- 172.21.15.103:0/2852308104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0068790 0x7f67b00729c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f67b00c49f0 tx=0x7f679802a1e0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 -- 172.21.15.103:0/2852308104 shutdown_connections 2024-09-19T05:40:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 --2- 172.21.15.103:0/2852308104 >> v2:172.21.15.174:3300/0 conn(0x7f67b0070bc0 0x7f67b0143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 --2- 172.21.15.103:0/2852308104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0068790 0x7f67b00729c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 --2- 172.21.15.103:0/2852308104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b0072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 -- 172.21.15.103:0/2852308104 >> 172.21.15.103:0/2852308104 conn(0x7f67b006cd20 msgr2=0x7f67b006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 -- 172.21.15.103:0/2852308104 shutdown_connections 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.932+0000 7f67b64b7640 1 -- 172.21.15.103:0/2852308104 wait complete. 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.933+0000 7f67b64b7640 1 Processor -- start 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.933+0000 7f67b64b7640 1 -- start start 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67b64b7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b01f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67b64b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0070bc0 0x7f67b01f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67b64b7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b01f4cb0 0x7f67b015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67b64b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0144390 con 0x7f67b0070bc0 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67b64b7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f67b015bc20 con 0x7f67b01f4cb0 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67b64b7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f67b006c260 con 0x7f67b006be80 2024-09-19T05:40:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0070bc0 0x7f67b01f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0070bc0 0x7f67b01f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39894/0 (socket says 172.21.15.103:39894) 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 -- 172.21.15.103:0/3410943875 learned_addr learned my addr 172.21.15.103:0/3410943875 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67b4a54640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b01f4cb0 0x7f67b015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67affff640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b01f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 -- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 msgr2=0x7f67b01f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b01f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 -- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b01f4cb0 msgr2=0x7f67b015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b01f4cb0 0x7f67b015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 -- 172.21.15.103:0/3410943875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b01f5120 con 0x7f67b0070bc0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.934+0000 7f67af7fe640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0070bc0 0x7f67b01f4770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f679802a220 tx=0x7f67980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.935+0000 7f67acff9640 1 -- 172.21.15.103:0/3410943875 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798041020 con 0x7f67b0070bc0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.935+0000 7f67acff9640 1 -- 172.21.15.103:0/3410943875 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67980306c0 con 0x7f67b0070bc0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.935+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b00c4d40 con 0x7f67b0070bc0 2024-09-19T05:40:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.935+0000 7f67acff9640 1 -- 172.21.15.103:0/3410943875 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798037040 con 0x7f67b0070bc0 2024-09-19T05:40:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.935+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b015ed70 con 0x7f67b0070bc0 2024-09-19T05:40:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.936+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b00738e0 con 0x7f67b0070bc0 2024-09-19T05:40:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.936+0000 7f67acff9640 1 -- 172.21.15.103:0/3410943875 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6798044020 con 0x7f67b0070bc0 2024-09-19T05:40:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.937+0000 7f67acff9640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f679006c2b0 0x7f679006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.937+0000 7f67acff9640 1 -- 172.21.15.103:0/3410943875 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f67980ac110 con 0x7f67b0070bc0 2024-09-19T05:40:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.937+0000 7f67affff640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f679006c2b0 0x7f679006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.937+0000 7f67affff640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f679006c2b0 0x7f679006e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:36.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:36.942+0000 7f67acff9640 1 -- 172.21.15.103:0/3410943875 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f67b00738e0 con 0x7f67b0070bc0 2024-09-19T05:40:37.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.103+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67b006d840 con 0x7f679006c2b0 2024-09-19T05:40:37.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.111+0000 7f67acff9640 1 -- 172.21.15.103:0/3410943875 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331313 (secure 0 0 0) 0x7f67b006d840 con 0x7f679006c2b0 2024-09-19T05:40:37.117 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:40:37.118 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:40:37.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f679006c2b0 msgr2=0x7f679006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:37.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f679006c2b0 0x7f679006e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).stop 2024-09-19T05:40:37.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0070bc0 msgr2=0x7f67b01f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:37.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0070bc0 0x7f67b01f4770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f679802a220 tx=0x7f67980046c0 comp rx=0 tx=0).stop 2024-09-19T05:40:37.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 shutdown_connections 2024-09-19T05:40:37.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f679006c2b0 0x7f679006e770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:37.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b01f4cb0 0x7f67b015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:37.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0070bc0 0x7f67b01f4770 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:37.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 --2- 172.21.15.103:0/3410943875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b006be80 0x7f67b01f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:37.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 >> 172.21.15.103:0/3410943875 conn(0x7f67b006cd20 msgr2=0x7f67b0072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:37.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 shutdown_connections 2024-09-19T05:40:37.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:37.114+0000 7f67b64b7640 1 -- 172.21.15.103:0/3410943875 wait complete. 2024-09-19T05:40:37.128 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-19T05:40:36.221143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639662,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":425,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2867200,"data_stored":2284388,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003160"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:50.207073+0000","last_change":"2024-09-19T05:37:42.783186+0000","last_active":"2024-09-19T05:39:50.207073+0000","last_peered":"2024-09-19T05:39:50.207073+0000","last_clean":"2024-09-19T05:39:50.207073+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:39:50.207073+0000","last_undegraded":"2024-09-19T05:39:50.207073+0000","last_fullsized":"2024-09-19T05:39:50.207073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744889+0000","last_change":"2024-09-19T05:37:43.793423+0000","last_active":"2024-09-19T05:40:24.744889+0000","last_peered":"2024-09-19T05:40:24.744889+0000","last_clean":"2024-09-19T05:40:24.744889+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:40:24.744889+0000","last_undegraded":"2024-09-19T05:40:24.744889+0000","last_fullsized":"2024-09-19T05:40:24.744889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965402+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:38:25.965402+0000","last_peered":"2024-09-19T05:38:25.965402+0000","last_clean":"2024-09-19T05:38:25.965402+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:38:25.965402+0000","last_undegraded":"2024-09-19T05:38:25.965402+0000","last_fullsized":"2024-09-19T05:38:25.965402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:48.057485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966602+0000","last_change":"2024-09-19T05:37:42.797401+0000","last_active":"2024-09-19T05:38:25.966602+0000","last_peered":"2024-09-19T05:38:25.966602+0000","last_clean":"2024-09-19T05:38:25.966602+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:38:25.966602+0000","last_undegraded":"2024-09-19T05:38:25.966602+0000","last_fullsized":"2024-09-19T05:38:25.966602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:54.872178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758717+0000","last_change":"2024-09-19T05:37:43.800869+0000","last_active":"2024-09-19T05:40:24.758717+0000","last_peered":"2024-09-19T05:40:24.758717+0000","last_clean":"2024-09-19T05:40:24.758717+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:40:24.758717+0000","last_undegraded":"2024-09-19T05:40:24.758717+0000","last_fullsized":"2024-09-19T05:40:24.758717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963867+0000","last_change":"2024-09-19T05:37:47.824220+0000","last_active":"2024-09-19T05:38:25.963867+0000","last_peered":"2024-09-19T05:38:25.963867+0000","last_clean":"2024-09-19T05:38:25.963867+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:38:25.963867+0000","last_undegraded":"2024-09-19T05:38:25.963867+0000","last_fullsized":"2024-09-19T05:38:25.963867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:14.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878401+0000","last_change":"2024-09-19T05:37:42.790643+0000","last_active":"2024-09-19T05:39:40.878401+0000","last_peered":"2024-09-19T05:39:40.878401+0000","last_clean":"2024-09-19T05:39:40.878401+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:39:40.878401+0000","last_undegraded":"2024-09-19T05:39:40.878401+0000","last_fullsized":"2024-09-19T05:39:40.878401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.119731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758867+0000","last_change":"2024-09-19T05:37:43.801604+0000","last_active":"2024-09-19T05:40:24.758867+0000","last_peered":"2024-09-19T05:40:24.758867+0000","last_clean":"2024-09-19T05:40:24.758867+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:40:24.758867+0000","last_undegraded":"2024-09-19T05:40:24.758867+0000","last_fullsized":"2024-09-19T05:40:24.758867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:00.831602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964212+0000","last_change":"2024-09-19T05:37:47.816155+0000","last_active":"2024-09-19T05:38:25.964212+0000","last_peered":"2024-09-19T05:38:25.964212+0000","last_clean":"2024-09-19T05:38:25.964212+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:38:25.964212+0000","last_undegraded":"2024-09-19T05:38:25.964212+0000","last_fullsized":"2024-09-19T05:38:25.964212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:57:45.402655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.956064+0000","last_change":"2024-09-19T05:37:42.791338+0000","last_active":"2024-09-19T05:38:28.956064+0000","last_peered":"2024-09-19T05:38:28.956064+0000","last_clean":"2024-09-19T05:38:28.956064+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:38:28.956064+0000","last_undegraded":"2024-09-19T05:38:28.956064+0000","last_fullsized":"2024-09-19T05:38:28.956064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:43.139892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758625+0000","last_change":"2024-09-19T05:37:43.801209+0000","last_active":"2024-09-19T05:40:24.758625+0000","last_peered":"2024-09-19T05:40:24.758625+0000","last_clean":"2024-09-19T05:40:24.758625+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:40:24.758625+0000","last_undegraded":"2024-09-19T05:40:24.758625+0000","last_fullsized":"2024-09-19T05:40:24.758625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:22:20.799021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963776+0000","last_change":"2024-09-19T05:37:47.816262+0000","last_active":"2024-09-19T05:38:25.963776+0000","last_peered":"2024-09-19T05:38:25.963776+0000","last_clean":"2024-09-19T05:38:25.963776+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:38:25.963776+0000","last_undegraded":"2024-09-19T05:38:25.963776+0000","last_fullsized":"2024-09-19T05:38:25.963776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:39.592879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751142+0000","last_change":"2024-09-19T05:37:43.788474+0000","last_active":"2024-09-19T05:40:24.751142+0000","last_peered":"2024-09-19T05:40:24.751142+0000","last_clean":"2024-09-19T05:40:24.751142+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:40:24.751142+0000","last_undegraded":"2024-09-19T05:40:24.751142+0000","last_fullsized":"2024-09-19T05:40:24.751142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:24.231370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.878423+0000","last_change":"2024-09-19T05:37:42.788397+0000","last_active":"2024-09-19T05:39:40.878423+0000","last_peered":"2024-09-19T05:39:40.878423+0000","last_clean":"2024-09-19T05:39:40.878423+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:39:40.878423+0000","last_undegraded":"2024-09-19T05:39:40.878423+0000","last_fullsized":"2024-09-19T05:39:40.878423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:46:44.953573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964596+0000","last_change":"2024-09-19T05:37:47.813235+0000","last_active":"2024-09-19T05:38:25.964596+0000","last_peered":"2024-09-19T05:38:25.964596+0000","last_clean":"2024-09-19T05:38:25.964596+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:38:25.964596+0000","last_undegraded":"2024-09-19T05:38:25.964596+0000","last_fullsized":"2024-09-19T05:38:25.964596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:40.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750298+0000","last_change":"2024-09-19T05:37:43.793167+0000","last_active":"2024-09-19T05:40:24.750298+0000","last_peered":"2024-09-19T05:40:24.750298+0000","last_clean":"2024-09-19T05:40:24.750298+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:40:24.750298+0000","last_undegraded":"2024-09-19T05:40:24.750298+0000","last_fullsized":"2024-09-19T05:40:24.750298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:55.207520+0000","last_change":"2024-09-19T05:37:42.790384+0000","last_active":"2024-09-19T05:39:55.207520+0000","last_peered":"2024-09-19T05:39:55.207520+0000","last_clean":"2024-09-19T05:39:55.207520+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:39:55.207520+0000","last_undegraded":"2024-09-19T05:39:55.207520+0000","last_fullsized":"2024-09-19T05:39:55.207520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964548+0000","last_change":"2024-09-19T05:37:47.816203+0000","last_active":"2024-09-19T05:38:25.964548+0000","last_peered":"2024-09-19T05:38:25.964548+0000","last_clean":"2024-09-19T05:38:25.964548+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:38:25.964548+0000","last_undegraded":"2024-09-19T05:38:25.964548+0000","last_fullsized":"2024-09-19T05:38:25.964548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:17.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750263+0000","last_change":"2024-09-19T05:37:43.789550+0000","last_active":"2024-09-19T05:40:24.750263+0000","last_peered":"2024-09-19T05:40:24.750263+0000","last_clean":"2024-09-19T05:40:24.750263+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:40:24.750263+0000","last_undegraded":"2024-09-19T05:40:24.750263+0000","last_fullsized":"2024-09-19T05:40:24.750263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:03.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:55.207476+0000","last_change":"2024-09-19T05:37:42.786812+0000","last_active":"2024-09-19T05:39:55.207476+0000","last_peered":"2024-09-19T05:39:55.207476+0000","last_clean":"2024-09-19T05:39:55.207476+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:39:55.207476+0000","last_undegraded":"2024-09-19T05:39:55.207476+0000","last_fullsized":"2024-09-19T05:39:55.207476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:05.208700+0000","last_change":"2024-09-19T05:37:48.360392+0000","last_active":"2024-09-19T05:40:05.208700+0000","last_peered":"2024-09-19T05:40:05.208700+0000","last_clean":"2024-09-19T05:40:05.208700+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:40:05.208700+0000","last_undegraded":"2024-09-19T05:40:05.208700+0000","last_fullsized":"2024-09-19T05:40:05.208700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.720132+0000","last_change":"2024-09-19T05:37:43.787720+0000","last_active":"2024-09-19T05:40:24.720132+0000","last_peered":"2024-09-19T05:40:24.720132+0000","last_clean":"2024-09-19T05:40:24.720132+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:40:24.720132+0000","last_undegraded":"2024-09-19T05:40:24.720132+0000","last_fullsized":"2024-09-19T05:40:24.720132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:10.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668599+0000","last_change":"2024-09-19T05:37:42.790053+0000","last_active":"2024-09-19T05:38:26.668599+0000","last_peered":"2024-09-19T05:38:26.668599+0000","last_clean":"2024-09-19T05:38:26.668599+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:38:26.668599+0000","last_undegraded":"2024-09-19T05:38:26.668599+0000","last_fullsized":"2024-09-19T05:38:26.668599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:43.651458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964806+0000","last_change":"2024-09-19T05:37:47.823866+0000","last_active":"2024-09-19T05:38:25.964806+0000","last_peered":"2024-09-19T05:38:25.964806+0000","last_clean":"2024-09-19T05:38:25.964806+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:38:25.964806+0000","last_undegraded":"2024-09-19T05:38:25.964806+0000","last_fullsized":"2024-09-19T05:38:25.964806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:32.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747349+0000","last_change":"2024-09-19T05:37:43.794118+0000","last_active":"2024-09-19T05:40:24.747349+0000","last_peered":"2024-09-19T05:40:24.747349+0000","last_clean":"2024-09-19T05:40:24.747349+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:40:24.747349+0000","last_undegraded":"2024-09-19T05:40:24.747349+0000","last_fullsized":"2024-09-19T05:40:24.747349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888103+0000","last_change":"2024-09-19T05:37:42.783200+0000","last_active":"2024-09-19T05:39:40.888103+0000","last_peered":"2024-09-19T05:39:40.888103+0000","last_clean":"2024-09-19T05:39:40.888103+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:39:40.888103+0000","last_undegraded":"2024-09-19T05:39:40.888103+0000","last_fullsized":"2024-09-19T05:39:40.888103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:36.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964361+0000","last_change":"2024-09-19T05:37:48.361440+0000","last_active":"2024-09-19T05:38:25.964361+0000","last_peered":"2024-09-19T05:38:25.964361+0000","last_clean":"2024-09-19T05:38:25.964361+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:38:25.964361+0000","last_undegraded":"2024-09-19T05:38:25.964361+0000","last_fullsized":"2024-09-19T05:38:25.964361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754785+0000","last_change":"2024-09-19T05:37:43.786771+0000","last_active":"2024-09-19T05:40:24.754785+0000","last_peered":"2024-09-19T05:40:24.754785+0000","last_clean":"2024-09-19T05:40:24.754785+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:40:24.754785+0000","last_undegraded":"2024-09-19T05:40:24.754785+0000","last_fullsized":"2024-09-19T05:40:24.754785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:00.366401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'15","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:55.207568+0000","last_change":"2024-09-19T05:37:42.783657+0000","last_active":"2024-09-19T05:39:55.207568+0000","last_peered":"2024-09-19T05:39:55.207568+0000","last_clean":"2024-09-19T05:39:55.207568+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:39:55.207568+0000","last_undegraded":"2024-09-19T05:39:55.207568+0000","last_fullsized":"2024-09-19T05:39:55.207568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.698091+0000","last_change":"2024-09-19T05:38:26.696320+0000","last_active":"2024-09-19T05:38:26.698091+0000","last_peered":"2024-09-19T05:38:26.698091+0000","last_clean":"2024-09-19T05:38:26.698091+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:38:26.698091+0000","last_undegraded":"2024-09-19T05:38:26.698091+0000","last_fullsized":"2024-09-19T05:38:26.698091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:33.249021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745617+0000","last_change":"2024-09-19T05:37:43.787640+0000","last_active":"2024-09-19T05:40:24.745617+0000","last_peered":"2024-09-19T05:40:24.745617+0000","last_clean":"2024-09-19T05:40:24.745617+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:40:24.745617+0000","last_undegraded":"2024-09-19T05:40:24.745617+0000","last_fullsized":"2024-09-19T05:40:24.745617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954034+0000","last_change":"2024-09-19T05:37:42.790155+0000","last_active":"2024-09-19T05:38:28.954034+0000","last_peered":"2024-09-19T05:38:28.954034+0000","last_clean":"2024-09-19T05:38:28.954034+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:38:28.954034+0000","last_undegraded":"2024-09-19T05:38:28.954034+0000","last_fullsized":"2024-09-19T05:38:28.954034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:08.216934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:55.207601+0000","last_change":"2024-09-19T05:37:48.360243+0000","last_active":"2024-09-19T05:39:55.207601+0000","last_peered":"2024-09-19T05:39:55.207601+0000","last_clean":"2024-09-19T05:39:55.207601+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:39:55.207601+0000","last_undegraded":"2024-09-19T05:39:55.207601+0000","last_fullsized":"2024-09-19T05:39:55.207601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758249+0000","last_change":"2024-09-19T05:37:43.796408+0000","last_active":"2024-09-19T05:40:24.758249+0000","last_peered":"2024-09-19T05:40:24.758249+0000","last_clean":"2024-09-19T05:40:24.758249+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:40:24.758249+0000","last_undegraded":"2024-09-19T05:40:24.758249+0000","last_fullsized":"2024-09-19T05:40:24.758249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.158122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:50.206904+0000","last_change":"2024-09-19T05:37:42.790587+0000","last_active":"2024-09-19T05:39:50.206904+0000","last_peered":"2024-09-19T05:39:50.206904+0000","last_clean":"2024-09-19T05:39:50.206904+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:39:50.206904+0000","last_undegraded":"2024-09-19T05:39:50.206904+0000","last_fullsized":"2024-09-19T05:39:50.206904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:55.207498+0000","last_change":"2024-09-19T05:37:47.822521+0000","last_active":"2024-09-19T05:39:55.207498+0000","last_peered":"2024-09-19T05:39:55.207498+0000","last_clean":"2024-09-19T05:39:55.207498+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:39:55.207498+0000","last_undegraded":"2024-09-19T05:39:55.207498+0000","last_fullsized":"2024-09-19T05:39:55.207498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745710+0000","last_change":"2024-09-19T05:37:43.791238+0000","last_active":"2024-09-19T05:40:24.745710+0000","last_peered":"2024-09-19T05:40:24.745710+0000","last_clean":"2024-09-19T05:40:24.745710+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:40:24.745710+0000","last_undegraded":"2024-09-19T05:40:24.745710+0000","last_fullsized":"2024-09-19T05:40:24.745710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958110+0000","last_change":"2024-09-19T05:37:42.788047+0000","last_active":"2024-09-19T05:38:28.958110+0000","last_peered":"2024-09-19T05:38:28.958110+0000","last_clean":"2024-09-19T05:38:28.958110+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:38:28.958110+0000","last_undegraded":"2024-09-19T05:38:28.958110+0000","last_fullsized":"2024-09-19T05:38:28.958110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:10.047768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:55.207532+0000","last_change":"2024-09-19T05:37:47.821528+0000","last_active":"2024-09-19T05:39:55.207532+0000","last_peered":"2024-09-19T05:39:55.207532+0000","last_clean":"2024-09-19T05:39:55.207532+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:39:55.207532+0000","last_undegraded":"2024-09-19T05:39:55.207532+0000","last_fullsized":"2024-09-19T05:39:55.207532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.744912+0000","last_change":"2024-09-19T05:37:43.792334+0000","last_active":"2024-09-19T05:40:24.744912+0000","last_peered":"2024-09-19T05:40:24.744912+0000","last_clean":"2024-09-19T05:40:24.744912+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:40:24.744912+0000","last_undegraded":"2024-09-19T05:40:24.744912+0000","last_fullsized":"2024-09-19T05:40:24.744912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'10","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.712420+0000","last_change":"2024-09-19T05:37:42.793045+0000","last_active":"2024-09-19T05:40:24.712420+0000","last_peered":"2024-09-19T05:40:24.712420+0000","last_clean":"2024-09-19T05:40:24.712420+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:40:24.712420+0000","last_undegraded":"2024-09-19T05:40:24.712420+0000","last_fullsized":"2024-09-19T05:40:24.712420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.208138+0000","last_change":"2024-09-19T05:37:47.821226+0000","last_active":"2024-09-19T05:40:00.208138+0000","last_peered":"2024-09-19T05:40:00.208138+0000","last_clean":"2024-09-19T05:40:00.208138+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:40:00.208138+0000","last_undegraded":"2024-09-19T05:40:00.208138+0000","last_fullsized":"2024-09-19T05:40:00.208138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745964+0000","last_change":"2024-09-19T05:37:43.797459+0000","last_active":"2024-09-19T05:40:24.745964+0000","last_peered":"2024-09-19T05:40:24.745964+0000","last_clean":"2024-09-19T05:40:24.745964+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:40:24.745964+0000","last_undegraded":"2024-09-19T05:40:24.745964+0000","last_fullsized":"2024-09-19T05:40:24.745964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.953555+0000","last_change":"2024-09-19T05:37:42.786344+0000","last_active":"2024-09-19T05:38:28.953555+0000","last_peered":"2024-09-19T05:38:28.953555+0000","last_clean":"2024-09-19T05:38:28.953555+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:38:28.953555+0000","last_undegraded":"2024-09-19T05:38:28.953555+0000","last_fullsized":"2024-09-19T05:38:28.953555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:23.770409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.208235+0000","last_change":"2024-09-19T05:37:48.360958+0000","last_active":"2024-09-19T05:40:00.208235+0000","last_peered":"2024-09-19T05:40:00.208235+0000","last_clean":"2024-09-19T05:40:00.208235+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:40:00.208235+0000","last_undegraded":"2024-09-19T05:40:00.208235+0000","last_fullsized":"2024-09-19T05:40:00.208235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763014+0000","last_change":"2024-09-19T05:37:43.800143+0000","last_active":"2024-09-19T05:40:24.763014+0000","last_peered":"2024-09-19T05:40:24.763014+0000","last_clean":"2024-09-19T05:40:24.763014+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:40:24.763014+0000","last_undegraded":"2024-09-19T05:40:24.763014+0000","last_fullsized":"2024-09-19T05:40:24.763014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:57.219721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.954148+0000","last_change":"2024-09-19T05:37:42.790749+0000","last_active":"2024-09-19T05:38:28.954148+0000","last_peered":"2024-09-19T05:38:28.954148+0000","last_clean":"2024-09-19T05:38:28.954148+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:38:28.954148+0000","last_undegraded":"2024-09-19T05:38:28.954148+0000","last_fullsized":"2024-09-19T05:38:28.954148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:31.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.668707+0000","last_change":"2024-09-19T05:37:33.265472+0000","last_active":"2024-09-19T05:38:26.668707+0000","last_peered":"2024-09-19T05:38:26.668707+0000","last_clean":"2024-09-19T05:38:26.668707+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:38:26.668707+0000","last_undegraded":"2024-09-19T05:38:26.668707+0000","last_fullsized":"2024-09-19T05:38:26.668707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:32.207121+0000","last_clean_scrub_stamp":"2024-09-19T05:37:32.207121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:31.074891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.963638+0000","last_change":"2024-09-19T05:37:48.361311+0000","last_active":"2024-09-19T05:38:25.963638+0000","last_peered":"2024-09-19T05:38:25.963638+0000","last_clean":"2024-09-19T05:38:25.963638+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:38:25.963638+0000","last_undegraded":"2024-09-19T05:38:25.963638+0000","last_fullsized":"2024-09-19T05:38:25.963638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.177991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759101+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:40:24.759101+0000","last_peered":"2024-09-19T05:40:24.759101+0000","last_clean":"2024-09-19T05:40:24.759101+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:40:24.759101+0000","last_undegraded":"2024-09-19T05:40:24.759101+0000","last_fullsized":"2024-09-19T05:40:24.759101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:54.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.715990+0000","last_change":"2024-09-19T05:37:42.791448+0000","last_active":"2024-09-19T05:40:24.715990+0000","last_peered":"2024-09-19T05:40:24.715990+0000","last_clean":"2024-09-19T05:40:24.715990+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:40:24.715990+0000","last_undegraded":"2024-09-19T05:40:24.715990+0000","last_fullsized":"2024-09-19T05:40:24.715990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697544+0000","last_change":"2024-09-19T05:38:26.696465+0000","last_active":"2024-09-19T05:38:26.697544+0000","last_peered":"2024-09-19T05:38:26.697544+0000","last_clean":"2024-09-19T05:38:26.697544+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:38:26.697544+0000","last_undegraded":"2024-09-19T05:38:26.697544+0000","last_fullsized":"2024-09-19T05:38:26.697544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:04.587288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757448+0000","last_change":"2024-09-19T05:37:43.798700+0000","last_active":"2024-09-19T05:40:24.757448+0000","last_peered":"2024-09-19T05:40:24.757448+0000","last_clean":"2024-09-19T05:40:24.757448+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:40:24.757448+0000","last_undegraded":"2024-09-19T05:40:24.757448+0000","last_fullsized":"2024-09-19T05:40:24.757448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:29.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.208086+0000","last_change":"2024-09-19T05:37:42.789464+0000","last_active":"2024-09-19T05:40:00.208086+0000","last_peered":"2024-09-19T05:40:00.208086+0000","last_clean":"2024-09-19T05:40:00.208086+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:40:00.208086+0000","last_undegraded":"2024-09-19T05:40:00.208086+0000","last_fullsized":"2024-09-19T05:40:00.208086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:05.208854+0000","last_change":"2024-09-19T05:37:47.818603+0000","last_active":"2024-09-19T05:40:05.208854+0000","last_peered":"2024-09-19T05:40:05.208854+0000","last_clean":"2024-09-19T05:40:05.208854+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:40:05.208854+0000","last_undegraded":"2024-09-19T05:40:05.208854+0000","last_fullsized":"2024-09-19T05:40:05.208854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.760116+0000","last_change":"2024-09-19T05:37:43.798130+0000","last_active":"2024-09-19T05:40:24.760116+0000","last_peered":"2024-09-19T05:40:24.760116+0000","last_clean":"2024-09-19T05:40:24.760116+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:40:24.760116+0000","last_undegraded":"2024-09-19T05:40:24.760116+0000","last_fullsized":"2024-09-19T05:40:24.760116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.486476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:00.207990+0000","last_change":"2024-09-19T05:37:42.793132+0000","last_active":"2024-09-19T05:40:00.207990+0000","last_peered":"2024-09-19T05:40:00.207990+0000","last_clean":"2024-09-19T05:40:00.207990+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:40:00.207990+0000","last_undegraded":"2024-09-19T05:40:00.207990+0000","last_fullsized":"2024-09-19T05:40:00.207990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.362359+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:38:26.362359+0000","last_peered":"2024-09-19T05:38:26.362359+0000","last_clean":"2024-09-19T05:38:26.362359+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:38:26.362359+0000","last_undegraded":"2024-09-19T05:38:26.362359+0000","last_fullsized":"2024-09-19T05:38:26.362359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:15.240414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758516+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:40:24.758516+0000","last_peered":"2024-09-19T05:40:24.758516+0000","last_clean":"2024-09-19T05:40:24.758516+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:40:24.758516+0000","last_undegraded":"2024-09-19T05:40:24.758516+0000","last_fullsized":"2024-09-19T05:40:24.758516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:41.887596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964847+0000","last_change":"2024-09-19T05:37:42.787361+0000","last_active":"2024-09-19T05:38:25.964847+0000","last_peered":"2024-09-19T05:38:25.964847+0000","last_clean":"2024-09-19T05:38:25.964847+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:38:25.964847+0000","last_undegraded":"2024-09-19T05:38:25.964847+0000","last_fullsized":"2024-09-19T05:38:25.964847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:14.052414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964045+0000","last_change":"2024-09-19T05:37:47.816376+0000","last_active":"2024-09-19T05:38:25.964045+0000","last_peered":"2024-09-19T05:38:25.964045+0000","last_clean":"2024-09-19T05:38:25.964045+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:38:25.964045+0000","last_undegraded":"2024-09-19T05:38:25.964045+0000","last_fullsized":"2024-09-19T05:38:25.964045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:33.649230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759461+0000","last_change":"2024-09-19T05:37:43.795111+0000","last_active":"2024-09-19T05:40:24.759461+0000","last_peered":"2024-09-19T05:40:24.759461+0000","last_clean":"2024-09-19T05:40:24.759461+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:40:24.759461+0000","last_undegraded":"2024-09-19T05:40:24.759461+0000","last_fullsized":"2024-09-19T05:40:24.759461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:20.294491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'18","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:05.208574+0000","last_change":"2024-09-19T05:37:42.781069+0000","last_active":"2024-09-19T05:40:05.208574+0000","last_peered":"2024-09-19T05:40:05.208574+0000","last_clean":"2024-09-19T05:40:05.208574+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:40:05.208574+0000","last_undegraded":"2024-09-19T05:40:05.208574+0000","last_fullsized":"2024-09-19T05:40:05.208574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:15.210108+0000","last_change":"2024-09-19T05:37:47.820132+0000","last_active":"2024-09-19T05:40:15.210108+0000","last_peered":"2024-09-19T05:40:15.210108+0000","last_clean":"2024-09-19T05:40:15.210108+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:40:15.210108+0000","last_undegraded":"2024-09-19T05:40:15.210108+0000","last_fullsized":"2024-09-19T05:40:15.210108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746363+0000","last_change":"2024-09-19T05:37:43.793365+0000","last_active":"2024-09-19T05:40:24.746363+0000","last_peered":"2024-09-19T05:40:24.746363+0000","last_clean":"2024-09-19T05:40:24.746363+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:40:24.746363+0000","last_undegraded":"2024-09-19T05:40:24.746363+0000","last_fullsized":"2024-09-19T05:40:24.746363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:57.809176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:02.210594+0000","last_change":"2024-09-19T05:37:42.786111+0000","last_active":"2024-09-19T05:40:02.210594+0000","last_peered":"2024-09-19T05:40:02.210594+0000","last_clean":"2024-09-19T05:40:02.210594+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:40:02.210594+0000","last_undegraded":"2024-09-19T05:40:02.210594+0000","last_fullsized":"2024-09-19T05:40:02.210594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:03.245117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.966334+0000","last_change":"2024-09-19T05:37:48.360316+0000","last_active":"2024-09-19T05:38:25.966334+0000","last_peered":"2024-09-19T05:38:25.966334+0000","last_clean":"2024-09-19T05:38:25.966334+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:38:25.966334+0000","last_undegraded":"2024-09-19T05:38:25.966334+0000","last_fullsized":"2024-09-19T05:38:25.966334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:47.174339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759895+0000","last_change":"2024-09-19T05:37:43.794298+0000","last_active":"2024-09-19T05:40:24.759895+0000","last_peered":"2024-09-19T05:40:24.759895+0000","last_clean":"2024-09-19T05:40:24.759895+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:40:24.759895+0000","last_undegraded":"2024-09-19T05:40:24.759895+0000","last_fullsized":"2024-09-19T05:40:24.759895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:07.040637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'6","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:40.888493+0000","last_change":"2024-09-19T05:37:42.793862+0000","last_active":"2024-09-19T05:39:40.888493+0000","last_peered":"2024-09-19T05:39:40.888493+0000","last_clean":"2024-09-19T05:39:40.888493+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:39:40.888493+0000","last_undegraded":"2024-09-19T05:39:40.888493+0000","last_fullsized":"2024-09-19T05:39:40.888493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:23.368397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965580+0000","last_change":"2024-09-19T05:37:48.361015+0000","last_active":"2024-09-19T05:38:25.965580+0000","last_peered":"2024-09-19T05:38:25.965580+0000","last_clean":"2024-09-19T05:38:25.965580+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:38:25.965580+0000","last_undegraded":"2024-09-19T05:38:25.965580+0000","last_fullsized":"2024-09-19T05:38:25.965580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:41.854023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763206+0000","last_change":"2024-09-19T05:37:43.788625+0000","last_active":"2024-09-19T05:40:24.763206+0000","last_peered":"2024-09-19T05:40:24.763206+0000","last_clean":"2024-09-19T05:40:24.763206+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:40:24.763206+0000","last_undegraded":"2024-09-19T05:40:24.763206+0000","last_fullsized":"2024-09-19T05:40:24.763206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:05.208875+0000","last_change":"2024-09-19T05:37:42.787200+0000","last_active":"2024-09-19T05:40:05.208875+0000","last_peered":"2024-09-19T05:40:05.208875+0000","last_clean":"2024-09-19T05:40:05.208875+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:40:05.208875+0000","last_undegraded":"2024-09-19T05:40:05.208875+0000","last_fullsized":"2024-09-19T05:40:05.208875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.363151+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:38:26.363151+0000","last_peered":"2024-09-19T05:38:26.363151+0000","last_clean":"2024-09-19T05:38:26.363151+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:38:26.363151+0000","last_undegraded":"2024-09-19T05:38:26.363151+0000","last_fullsized":"2024-09-19T05:38:26.363151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:06.900210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753826+0000","last_change":"2024-09-19T05:37:43.791889+0000","last_active":"2024-09-19T05:40:24.753826+0000","last_peered":"2024-09-19T05:40:24.753826+0000","last_clean":"2024-09-19T05:40:24.753826+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:40:24.753826+0000","last_undegraded":"2024-09-19T05:40:24.753826+0000","last_fullsized":"2024-09-19T05:40:24.753826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:57.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'33","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.714069+0000","last_change":"2024-09-19T05:37:42.792478+0000","last_active":"2024-09-19T05:40:24.714069+0000","last_peered":"2024-09-19T05:40:24.714069+0000","last_clean":"2024-09-19T05:40:24.714069+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:40:24.714069+0000","last_undegraded":"2024-09-19T05:40:24.714069+0000","last_fullsized":"2024-09-19T05:40:24.714069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:42.802823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'3","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:10.209191+0000","last_change":"2024-09-19T05:37:47.820556+0000","last_active":"2024-09-19T05:40:10.209191+0000","last_peered":"2024-09-19T05:40:10.209191+0000","last_clean":"2024-09-19T05:40:10.209191+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:40:10.209191+0000","last_undegraded":"2024-09-19T05:40:10.209191+0000","last_fullsized":"2024-09-19T05:40:10.209191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762696+0000","last_change":"2024-09-19T05:37:43.786586+0000","last_active":"2024-09-19T05:40:24.762696+0000","last_peered":"2024-09-19T05:40:24.762696+0000","last_clean":"2024-09-19T05:40:24.762696+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:40:24.762696+0000","last_undegraded":"2024-09-19T05:40:24.762696+0000","last_fullsized":"2024-09-19T05:40:24.762696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:59.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:10.209224+0000","last_change":"2024-09-19T05:37:42.791215+0000","last_active":"2024-09-19T05:40:10.209224+0000","last_peered":"2024-09-19T05:40:10.209224+0000","last_clean":"2024-09-19T05:40:10.209224+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:40:10.209224+0000","last_undegraded":"2024-09-19T05:40:10.209224+0000","last_fullsized":"2024-09-19T05:40:10.209224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.964401+0000","last_change":"2024-09-19T05:37:47.813827+0000","last_active":"2024-09-19T05:38:25.964401+0000","last_peered":"2024-09-19T05:38:25.964401+0000","last_clean":"2024-09-19T05:38:25.964401+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:38:25.964401+0000","last_undegraded":"2024-09-19T05:38:25.964401+0000","last_fullsized":"2024-09-19T05:38:25.964401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:59:16.332337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758943+0000","last_change":"2024-09-19T05:37:43.800826+0000","last_active":"2024-09-19T05:40:24.758943+0000","last_peered":"2024-09-19T05:40:24.758943+0000","last_clean":"2024-09-19T05:40:24.758943+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:40:24.758943+0000","last_undegraded":"2024-09-19T05:40:24.758943+0000","last_fullsized":"2024-09-19T05:40:24.758943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955439+0000","last_change":"2024-09-19T05:37:42.793243+0000","last_active":"2024-09-19T05:38:28.955439+0000","last_peered":"2024-09-19T05:38:28.955439+0000","last_clean":"2024-09-19T05:38:28.955439+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:38:28.955439+0000","last_undegraded":"2024-09-19T05:38:28.955439+0000","last_fullsized":"2024-09-19T05:38:28.955439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:54.887225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965127+0000","last_change":"2024-09-19T05:37:47.817044+0000","last_active":"2024-09-19T05:38:25.965127+0000","last_peered":"2024-09-19T05:38:25.965127+0000","last_clean":"2024-09-19T05:38:25.965127+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:38:25.965127+0000","last_undegraded":"2024-09-19T05:38:25.965127+0000","last_fullsized":"2024-09-19T05:38:25.965127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:24.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754364+0000","last_change":"2024-09-19T05:38:26.669788+0000","last_active":"2024-09-19T05:40:24.754364+0000","last_peered":"2024-09-19T05:40:24.754364+0000","last_clean":"2024-09-19T05:40:24.754364+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:40:24.754364+0000","last_undegraded":"2024-09-19T05:40:24.754364+0000","last_fullsized":"2024-09-19T05:40:24.754364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.712502+0000","last_change":"2024-09-19T05:37:42.791163+0000","last_active":"2024-09-19T05:40:24.712502+0000","last_peered":"2024-09-19T05:40:24.712502+0000","last_clean":"2024-09-19T05:40:24.712502+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:40:24.712502+0000","last_undegraded":"2024-09-19T05:40:24.712502+0000","last_fullsized":"2024-09-19T05:40:24.712502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:29.099941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965500+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:38:25.965500+0000","last_peered":"2024-09-19T05:38:25.965500+0000","last_clean":"2024-09-19T05:38:25.965500+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:38:25.965500+0000","last_undegraded":"2024-09-19T05:38:25.965500+0000","last_fullsized":"2024-09-19T05:38:25.965500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:20.812032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:50.207020+0000","last_change":"2024-09-19T05:37:48.360417+0000","last_active":"2024-09-19T05:39:50.207020+0000","last_peered":"2024-09-19T05:39:50.207020+0000","last_clean":"2024-09-19T05:39:50.207020+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:39:50.207020+0000","last_undegraded":"2024-09-19T05:39:50.207020+0000","last_fullsized":"2024-09-19T05:39:50.207020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'10","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750904+0000","last_change":"2024-09-19T05:37:43.789959+0000","last_active":"2024-09-19T05:40:24.750904+0000","last_peered":"2024-09-19T05:40:24.750904+0000","last_clean":"2024-09-19T05:40:24.750904+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:40:24.750904+0000","last_undegraded":"2024-09-19T05:40:24.750904+0000","last_fullsized":"2024-09-19T05:40:24.750904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.958056+0000","last_change":"2024-09-19T05:37:42.793702+0000","last_active":"2024-09-19T05:38:28.958056+0000","last_peered":"2024-09-19T05:38:28.958056+0000","last_clean":"2024-09-19T05:38:28.958056+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:38:28.958056+0000","last_undegraded":"2024-09-19T05:38:28.958056+0000","last_fullsized":"2024-09-19T05:38:28.958056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:11.540075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:26.697541+0000","last_change":"2024-09-19T05:38:26.696467+0000","last_active":"2024-09-19T05:38:26.697541+0000","last_peered":"2024-09-19T05:38:26.697541+0000","last_clean":"2024-09-19T05:38:26.697541+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:38:26.697541+0000","last_undegraded":"2024-09-19T05:38:26.697541+0000","last_fullsized":"2024-09-19T05:38:26.697541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:43.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750330+0000","last_change":"2024-09-19T05:37:43.793848+0000","last_active":"2024-09-19T05:40:24.750330+0000","last_peered":"2024-09-19T05:40:24.750330+0000","last_clean":"2024-09-19T05:40:24.750330+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:40:24.750330+0000","last_undegraded":"2024-09-19T05:40:24.750330+0000","last_fullsized":"2024-09-19T05:40:24.750330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.120720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:28.955735+0000","last_change":"2024-09-19T05:37:42.792529+0000","last_active":"2024-09-19T05:38:28.955735+0000","last_peered":"2024-09-19T05:38:28.955735+0000","last_clean":"2024-09-19T05:38:28.955735+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:38:28.955735+0000","last_undegraded":"2024-09-19T05:38:28.955735+0000","last_fullsized":"2024-09-19T05:38:28.955735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:37.122248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965075+0000","last_change":"2024-09-19T05:37:42.786191+0000","last_active":"2024-09-19T05:38:25.965075+0000","last_peered":"2024-09-19T05:38:25.965075+0000","last_clean":"2024-09-19T05:38:25.965075+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:38:25.965075+0000","last_undegraded":"2024-09-19T05:38:25.965075+0000","last_fullsized":"2024-09-19T05:38:25.965075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:14.411985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:25.072235+0000","last_change":"2024-09-19T05:37:43.795639+0000","last_active":"2024-09-19T05:40:25.072235+0000","last_peered":"2024-09-19T05:40:25.072235+0000","last_clean":"2024-09-19T05:40:25.072235+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:40:25.072235+0000","last_undegraded":"2024-09-19T05:40:25.072235+0000","last_fullsized":"2024-09-19T05:40:25.072235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:20.210490+0000","last_change":"2024-09-19T05:37:47.813023+0000","last_active":"2024-09-19T05:40:20.210490+0000","last_peered":"2024-09-19T05:40:20.210490+0000","last_clean":"2024-09-19T05:40:20.210490+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:40:20.210490+0000","last_undegraded":"2024-09-19T05:40:20.210490+0000","last_fullsized":"2024-09-19T05:40:20.210490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:12.207200+0000","last_change":"2024-09-19T05:37:42.789071+0000","last_active":"2024-09-19T05:40:12.207200+0000","last_peered":"2024-09-19T05:40:12.207200+0000","last_clean":"2024-09-19T05:40:12.207200+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:40:12.207200+0000","last_undegraded":"2024-09-19T05:40:12.207200+0000","last_fullsized":"2024-09-19T05:40:12.207200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:41.759818+0000","last_clean_scrub_stamp":"2024-09-19T05:37:41.759818+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:47.384691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1206,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.738115+0000","last_change":"2024-09-19T05:37:43.787777+0000","last_active":"2024-09-19T05:40:24.738115+0000","last_peered":"2024-09-19T05:40:24.738115+0000","last_clean":"2024-09-19T05:40:24.738115+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:40:24.738115+0000","last_undegraded":"2024-09-19T05:40:24.738115+0000","last_fullsized":"2024-09-19T05:40:24.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:40.238093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:38:25.965158+0000","last_change":"2024-09-19T05:37:47.818902+0000","last_active":"2024-09-19T05:38:25.965158+0000","last_peered":"2024-09-19T05:38:25.965158+0000","last_clean":"2024-09-19T05:38:25.965158+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:38:25.965158+0000","last_undegraded":"2024-09-19T05:38:25.965158+0000","last_fullsized":"2024-09-19T05:38:25.965158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:19.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.750202+0000","last_change":"2024-09-19T05:37:43.793682+0000","last_active":"2024-09-19T05:40:24.750202+0000","last_peered":"2024-09-19T05:40:24.750202+0000","last_clean":"2024-09-19T05:40:24.750202+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:40:24.750202+0000","last_undegraded":"2024-09-19T05:40:24.750202+0000","last_fullsized":"2024-09-19T05:40:24.750202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:52.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748578+0000","last_change":"2024-09-19T05:38:25.967860+0000","last_active":"2024-09-19T05:40:24.748578+0000","last_peered":"2024-09-19T05:40:24.748578+0000","last_clean":"2024-09-19T05:40:24.748578+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:40:24.748578+0000","last_undegraded":"2024-09-19T05:40:24.748578+0000","last_fullsized":"2024-09-19T05:40:24.748578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757981+0000","last_change":"2024-09-19T05:37:43.798488+0000","last_active":"2024-09-19T05:40:24.757981+0000","last_peered":"2024-09-19T05:40:24.757981+0000","last_clean":"2024-09-19T05:40:24.757981+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:40:24.757981+0000","last_undegraded":"2024-09-19T05:40:24.757981+0000","last_fullsized":"2024-09-19T05:40:24.757981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:45.923501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:34.447005+0000","last_change":"2024-09-19T05:40:34.447027+0000","last_active":"2024-09-19T05:40:34.447005+0000","last_peered":"2024-09-19T05:40:34.447005+0000","last_clean":"2024-09-19T05:40:34.447005+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:40:34.447005+0000","last_undegraded":"2024-09-19T05:40:34.447005+0000","last_fullsized":"2024-09-19T05:40:34.447005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:34.446941+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:34.446941+0000","last_clean_scrub_stamp":"2024-09-19T05:40:34.446941+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:52.636285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:34.663656+0000","last_change":"2024-09-19T05:38:25.967776+0000","last_active":"2024-09-19T05:40:34.663656+0000","last_peered":"2024-09-19T05:40:34.663656+0000","last_clean":"2024-09-19T05:40:34.663656+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:40:34.663656+0000","last_undegraded":"2024-09-19T05:40:34.663656+0000","last_fullsized":"2024-09-19T05:40:34.663656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.749754+0000","last_change":"2024-09-19T05:37:43.785589+0000","last_active":"2024-09-19T05:40:24.749754+0000","last_peered":"2024-09-19T05:40:24.749754+0000","last_clean":"2024-09-19T05:40:24.749754+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:40:24.749754+0000","last_undegraded":"2024-09-19T05:40:24.749754+0000","last_fullsized":"2024-09-19T05:40:24.749754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.753563+0000","last_change":"2024-09-19T05:37:43.796794+0000","last_active":"2024-09-19T05:40:24.753563+0000","last_peered":"2024-09-19T05:40:24.753563+0000","last_clean":"2024-09-19T05:40:24.753563+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:40:24.753563+0000","last_undegraded":"2024-09-19T05:40:24.753563+0000","last_fullsized":"2024-09-19T05:40:24.753563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:50:42.370682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748932+0000","last_change":"2024-09-19T05:37:43.794729+0000","last_active":"2024-09-19T05:40:24.748932+0000","last_peered":"2024-09-19T05:40:24.748932+0000","last_clean":"2024-09-19T05:40:24.748932+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:40:24.748932+0000","last_undegraded":"2024-09-19T05:40:24.748932+0000","last_fullsized":"2024-09-19T05:40:24.748932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:23.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758003+0000","last_change":"2024-09-19T05:37:43.791716+0000","last_active":"2024-09-19T05:40:24.758003+0000","last_peered":"2024-09-19T05:40:24.758003+0000","last_clean":"2024-09-19T05:40:24.758003+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:40:24.758003+0000","last_undegraded":"2024-09-19T05:40:24.758003+0000","last_fullsized":"2024-09-19T05:40:24.758003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:32.380572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751615+0000","last_change":"2024-09-19T05:37:43.793612+0000","last_active":"2024-09-19T05:40:24.751615+0000","last_peered":"2024-09-19T05:40:24.751615+0000","last_clean":"2024-09-19T05:40:24.751615+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:40:24.751615+0000","last_undegraded":"2024-09-19T05:40:24.751615+0000","last_fullsized":"2024-09-19T05:40:24.751615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:43.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759252+0000","last_change":"2024-09-19T05:37:43.798911+0000","last_active":"2024-09-19T05:40:24.759252+0000","last_peered":"2024-09-19T05:40:24.759252+0000","last_clean":"2024-09-19T05:40:24.759252+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:40:24.759252+0000","last_undegraded":"2024-09-19T05:40:24.759252+0000","last_fullsized":"2024-09-19T05:40:24.759252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:54.831063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.763490+0000","last_change":"2024-09-19T05:37:43.788884+0000","last_active":"2024-09-19T05:40:24.763490+0000","last_peered":"2024-09-19T05:40:24.763490+0000","last_clean":"2024-09-19T05:40:24.763490+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:40:24.763490+0000","last_undegraded":"2024-09-19T05:40:24.763490+0000","last_fullsized":"2024-09-19T05:40:24.763490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.749502+0000","last_change":"2024-09-19T05:37:43.788914+0000","last_active":"2024-09-19T05:40:24.749502+0000","last_peered":"2024-09-19T05:40:24.749502+0000","last_clean":"2024-09-19T05:40:24.749502+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:40:24.749502+0000","last_undegraded":"2024-09-19T05:40:24.749502+0000","last_fullsized":"2024-09-19T05:40:24.749502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:14.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.751376+0000","last_change":"2024-09-19T05:37:43.795162+0000","last_active":"2024-09-19T05:40:24.751376+0000","last_peered":"2024-09-19T05:40:24.751376+0000","last_clean":"2024-09-19T05:40:24.751376+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:40:24.751376+0000","last_undegraded":"2024-09-19T05:40:24.751376+0000","last_fullsized":"2024-09-19T05:40:24.751376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:09.569561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.742512+0000","last_change":"2024-09-19T05:37:43.791571+0000","last_active":"2024-09-19T05:40:24.742512+0000","last_peered":"2024-09-19T05:40:24.742512+0000","last_clean":"2024-09-19T05:40:24.742512+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:40:24.742512+0000","last_undegraded":"2024-09-19T05:40:24.742512+0000","last_fullsized":"2024-09-19T05:40:24.742512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757641+0000","last_change":"2024-09-19T05:37:43.798759+0000","last_active":"2024-09-19T05:40:24.757641+0000","last_peered":"2024-09-19T05:40:24.757641+0000","last_clean":"2024-09-19T05:40:24.757641+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:40:24.757641+0000","last_undegraded":"2024-09-19T05:40:24.757641+0000","last_fullsized":"2024-09-19T05:40:24.757641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:00.064515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.757694+0000","last_change":"2024-09-19T05:37:43.799857+0000","last_active":"2024-09-19T05:40:24.757694+0000","last_peered":"2024-09-19T05:40:24.757694+0000","last_clean":"2024-09-19T05:40:24.757694+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:40:24.757694+0000","last_undegraded":"2024-09-19T05:40:24.757694+0000","last_fullsized":"2024-09-19T05:40:24.757694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:47.671935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:34.260251+0000","last_change":"2024-09-19T05:40:34.260275+0000","last_active":"2024-09-19T05:40:34.260251+0000","last_peered":"2024-09-19T05:40:34.260251+0000","last_clean":"2024-09-19T05:40:34.260251+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:40:34.260251+0000","last_undegraded":"2024-09-19T05:40:34.260251+0000","last_fullsized":"2024-09-19T05:40:34.260251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:34.260181+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:34.260181+0000","last_clean_scrub_stamp":"2024-09-19T05:40:34.260181+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:22.732175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.747709+0000","last_change":"2024-09-19T05:37:43.789428+0000","last_active":"2024-09-19T05:40:24.747709+0000","last_peered":"2024-09-19T05:40:24.747709+0000","last_clean":"2024-09-19T05:40:24.747709+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:40:24.747709+0000","last_undegraded":"2024-09-19T05:40:24.747709+0000","last_fullsized":"2024-09-19T05:40:24.747709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754142+0000","last_change":"2024-09-19T05:37:43.794203+0000","last_active":"2024-09-19T05:40:24.754142+0000","last_peered":"2024-09-19T05:40:24.754142+0000","last_clean":"2024-09-19T05:40:24.754142+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:40:24.754142+0000","last_undegraded":"2024-09-19T05:40:24.754142+0000","last_fullsized":"2024-09-19T05:40:24.754142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.722578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.740195+0000","last_change":"2024-09-19T05:37:43.794081+0000","last_active":"2024-09-19T05:40:24.740195+0000","last_peered":"2024-09-19T05:40:24.740195+0000","last_clean":"2024-09-19T05:40:24.740195+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:40:24.740195+0000","last_undegraded":"2024-09-19T05:40:24.740195+0000","last_fullsized":"2024-09-19T05:40:24.740195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:35.735283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745746+0000","last_change":"2024-09-19T05:38:25.968706+0000","last_active":"2024-09-19T05:40:24.745746+0000","last_peered":"2024-09-19T05:40:24.745746+0000","last_clean":"2024-09-19T05:40:24.745746+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:40:24.745746+0000","last_undegraded":"2024-09-19T05:40:24.745746+0000","last_fullsized":"2024-09-19T05:40:24.745746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:52.340314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758868+0000","last_change":"2024-09-19T05:37:43.801893+0000","last_active":"2024-09-19T05:40:24.758868+0000","last_peered":"2024-09-19T05:40:24.758868+0000","last_clean":"2024-09-19T05:40:24.758868+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:40:24.758868+0000","last_undegraded":"2024-09-19T05:40:24.758868+0000","last_fullsized":"2024-09-19T05:40:24.758868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.967687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758530+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:40:24.758530+0000","last_peered":"2024-09-19T05:40:24.758530+0000","last_clean":"2024-09-19T05:40:24.758530+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:40:24.758530+0000","last_undegraded":"2024-09-19T05:40:24.758530+0000","last_fullsized":"2024-09-19T05:40:24.758530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:33:21.537421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.762985+0000","last_change":"2024-09-19T05:37:43.791590+0000","last_active":"2024-09-19T05:40:24.762985+0000","last_peered":"2024-09-19T05:40:24.762985+0000","last_clean":"2024-09-19T05:40:24.762985+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:40:24.762985+0000","last_undegraded":"2024-09-19T05:40:24.762985+0000","last_fullsized":"2024-09-19T05:40:24.762985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:25.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.756104+0000","last_change":"2024-09-19T05:37:43.795413+0000","last_active":"2024-09-19T05:40:24.756104+0000","last_peered":"2024-09-19T05:40:24.756104+0000","last_clean":"2024-09-19T05:40:24.756104+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:40:24.756104+0000","last_undegraded":"2024-09-19T05:40:24.756104+0000","last_fullsized":"2024-09-19T05:40:24.756104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:35.480307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759188+0000","last_change":"2024-09-19T05:37:43.801501+0000","last_active":"2024-09-19T05:40:24.759188+0000","last_peered":"2024-09-19T05:40:24.759188+0000","last_clean":"2024-09-19T05:40:24.759188+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:40:24.759188+0000","last_undegraded":"2024-09-19T05:40:24.759188+0000","last_fullsized":"2024-09-19T05:40:24.759188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:21.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.745715+0000","last_change":"2024-09-19T05:37:43.793157+0000","last_active":"2024-09-19T05:40:24.745715+0000","last_peered":"2024-09-19T05:40:24.745715+0000","last_clean":"2024-09-19T05:40:24.745715+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:40:24.745715+0000","last_undegraded":"2024-09-19T05:40:24.745715+0000","last_fullsized":"2024-09-19T05:40:24.745715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:39.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758744+0000","last_change":"2024-09-19T05:37:43.796775+0000","last_active":"2024-09-19T05:40:24.758744+0000","last_peered":"2024-09-19T05:40:24.758744+0000","last_clean":"2024-09-19T05:40:24.758744+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:40:24.758744+0000","last_undegraded":"2024-09-19T05:40:24.758744+0000","last_fullsized":"2024-09-19T05:40:24.758744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:03.284105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.748349+0000","last_change":"2024-09-19T05:37:43.793664+0000","last_active":"2024-09-19T05:40:24.748349+0000","last_peered":"2024-09-19T05:40:24.748349+0000","last_clean":"2024-09-19T05:40:24.748349+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:40:24.748349+0000","last_undegraded":"2024-09-19T05:40:24.748349+0000","last_fullsized":"2024-09-19T05:40:24.748349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.746788+0000","last_change":"2024-09-19T05:37:43.791094+0000","last_active":"2024-09-19T05:40:24.746788+0000","last_peered":"2024-09-19T05:40:24.746788+0000","last_clean":"2024-09-19T05:40:24.746788+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:40:24.746788+0000","last_undegraded":"2024-09-19T05:40:24.746788+0000","last_fullsized":"2024-09-19T05:40:24.746788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.754945+0000","last_change":"2024-09-19T05:37:43.791622+0000","last_active":"2024-09-19T05:40:24.754945+0000","last_peered":"2024-09-19T05:40:24.754945+0000","last_clean":"2024-09-19T05:40:24.754945+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:40:24.754945+0000","last_undegraded":"2024-09-19T05:40:24.754945+0000","last_fullsized":"2024-09-19T05:40:24.754945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:44.017693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49294,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":264,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":98588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718685,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":167715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":168161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":128091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":42528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:37.137 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.137 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.137 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.137 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.137 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.137 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.138 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.139 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.140 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.141 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T05:37:32.207121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.142 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.143 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.144 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.145 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.146 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-19T05:37:41.759818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.147 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.148 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.149 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.150 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.151 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.151 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.151 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.151 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:37.151 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T05:40:42.951 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:42.955 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:40:57.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:40:57.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.262+0000 7f5991dff640 1 Processor -- start 2024-09-19T05:40:57.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.262+0000 7f5991dff640 1 -- start start 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.262+0000 7f5991dff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f598c152d20 0x7f598c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f5991dff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f598c153100 0x7f598c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f5991dff640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f598c15c330 con 0x7f598c06ce10 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f5991dff640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f598c15d190 con 0x7f598c153100 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f5991dff640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f598c15c610 con 0x7f598c152d20 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598affd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f598c153100 0x7f598c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598affd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f598c153100 0x7f598c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41110/0 (socket says 172.21.15.103:41110) 2024-09-19T05:40:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f598c06ce10 0x7f598c158ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33210/0 (socket says 172.21.15.103:33210) 2024-09-19T05:40:57.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598affd640 1 -- 172.21.15.103:0/1445764797 learned_addr learned my addr 172.21.15.103:0/1445764797 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:57.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598b7fe640 1 --2- 172.21.15.103:0/1445764797 >> v2:172.21.15.174:3300/0 conn(0x7f598c152d20 0x7f598c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598affd640 1 -- 172.21.15.103:0/1445764797 >> v2:172.21.15.174:3300/0 conn(0x7f598c152d20 msgr2=0x7f598c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598affd640 1 --2- 172.21.15.103:0/1445764797 >> v2:172.21.15.174:3300/0 conn(0x7f598c152d20 0x7f598c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598affd640 1 -- 172.21.15.103:0/1445764797 >> v1:172.21.15.103:6789/0 conn(0x7f598c06ce10 legacy=0x7f598c158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.263+0000 7f598affd640 1 -- 172.21.15.103:0/1445764797 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c15c8f0 con 0x7f598c153100 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.264+0000 7f598affd640 1 --2- 172.21.15.103:0/1445764797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c0c5c60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f598c0cd610 tx=0x7f598002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764b6633c719e89e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.264+0000 7f598a7fc640 1 -- 172.21.15.103:0/1445764797 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980037070 con 0x7f598c153100 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.264+0000 7f598a7fc640 1 -- 172.21.15.103:0/1445764797 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5980032440 con 0x7f598c153100 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.264+0000 7f598a7fc640 1 -- 172.21.15.103:0/1445764797 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980032810 con 0x7f598c153100 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.264+0000 7f5991dff640 1 -- 172.21.15.103:0/1445764797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 msgr2=0x7f598c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.265+0000 7f5991dff640 1 --2- 172.21.15.103:0/1445764797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c0c5c60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f598c0cd610 tx=0x7f598002a150 comp rx=0 tx=0).stop 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.265+0000 7f5991dff640 1 -- 172.21.15.103:0/1445764797 shutdown_connections 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.265+0000 7f5991dff640 1 --2- 172.21.15.103:0/1445764797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c0c5c60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.265+0000 7f5991dff640 1 --2- 172.21.15.103:0/1445764797 >> v2:172.21.15.174:3300/0 conn(0x7f598c152d20 0x7f598c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.265+0000 7f5991dff640 1 -- 172.21.15.103:0/1445764797 >> 172.21.15.103:0/1445764797 conn(0x7f598c0c9230 msgr2=0x7f598c0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.265+0000 7f5991dff640 1 -- 172.21.15.103:0/1445764797 shutdown_connections 2024-09-19T05:40:57.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.265+0000 7f5991dff640 1 -- 172.21.15.103:0/1445764797 wait complete. 2024-09-19T05:40:57.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.266+0000 7f5991dff640 1 Processor -- start 2024-09-19T05:40:57.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.266+0000 7f5991dff640 1 -- start start 2024-09-19T05:40:57.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f5991dff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f598c06ce10 0x7f598c155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f5991dff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f598c152d20 0x7f598c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f5991dff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f5991dff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f598c159700 con 0x7f598c153100 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f5991dff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f598c15ceb0 con 0x7f598c152d20 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f5991dff640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f598c159880 con 0x7f598c06ce10 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41126/0 (socket says 172.21.15.103:41126) 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 -- 172.21.15.103:0/3172682040 learned_addr learned my addr 172.21.15.103:0/3172682040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598affd640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f598c152d20 0x7f598c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598b7fe640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f598c06ce10 0x7f598c155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 -- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f598c06ce10 msgr2=0x7f598c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f598c06ce10 0x7f598c155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 -- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f598c152d20 msgr2=0x7f598c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f598c152d20 0x7f598c155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 -- 172.21.15.103:0/3172682040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c14d040 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598affd640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f598c152d20 0x7f598c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.267+0000 7f598bfff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c156140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f598400c730 tx=0x7f598400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.268+0000 7f5973fff640 1 -- 172.21.15.103:0/3172682040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984017070 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.268+0000 7f5973fff640 1 -- 172.21.15.103:0/3172682040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598400ce40 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.268+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598c1ee9a0 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.268+0000 7f5973fff640 1 -- 172.21.15.103:0/3172682040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598400a840 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.268+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598c14d2e0 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.269+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598c1eeb70 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.269+0000 7f5973fff640 1 -- 172.21.15.103:0/3172682040 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f598401a070 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.270+0000 7f5973fff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f597806c2e0 0x7f597806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.270+0000 7f5973fff640 1 -- 172.21.15.103:0/3172682040 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f598408ac70 con 0x7f598c153100 2024-09-19T05:40:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.270+0000 7f598b7fe640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f597806c2e0 0x7f597806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.270+0000 7f598b7fe640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f597806c2e0 0x7f597806e7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f597c009970 tx=0x7f597c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.274+0000 7f5973fff640 1 -- 172.21.15.103:0/3172682040 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5984058990 con 0x7f598c153100 2024-09-19T05:40:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.436+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f598c074480 con 0x7f597806c2e0 2024-09-19T05:40:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.443+0000 7f5973fff640 1 -- 172.21.15.103:0/3172682040 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332847 (secure 0 0 0) 0x7f598c074480 con 0x7f597806c2e0 2024-09-19T05:40:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:40:57.452 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f597806c2e0 msgr2=0x7f597806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f597806c2e0 0x7f597806e7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f597c009970 tx=0x7f597c008040 comp rx=0 tx=0).stop 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 msgr2=0x7f598c156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c156140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f598400c730 tx=0x7f598400cbf0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 shutdown_connections 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f597806c2e0 0x7f597806e7a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f598c153100 0x7f598c156140 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f598c152d20 0x7f598c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 --2- 172.21.15.103:0/3172682040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f598c06ce10 0x7f598c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 >> 172.21.15.103:0/3172682040 conn(0x7f598c0c9230 msgr2=0x7f598c071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 shutdown_connections 2024-09-19T05:40:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:40:57.447+0000 7f5991dff640 1 -- 172.21.15.103:0/3172682040 wait complete. 2024-09-19T05:40:57.460 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-19T05:40:56.226624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639662,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":425,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":949,"ondisk_log_size":949,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2867200,"data_stored":2284388,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.1f","version":"28'19","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.446423+0000","last_change":"2024-09-19T05:40:35.446455+0000","last_active":"2024-09-19T05:40:35.446423+0000","last_peered":"2024-09-19T05:40:35.446423+0000","last_clean":"2024-09-19T05:40:35.446423+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:40:35.446423+0000","last_undegraded":"2024-09-19T05:40:35.446423+0000","last_fullsized":"2024-09-19T05:40:35.446423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-19T05:40:35.446360+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-19T05:40:35.446360+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.446360+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:12.720036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.834061+0000","last_change":"2024-09-19T05:40:46.834106+0000","last_active":"2024-09-19T05:40:46.834061+0000","last_peered":"2024-09-19T05:40:46.834061+0000","last_clean":"2024-09-19T05:40:46.834061+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:40:46.834061+0000","last_undegraded":"2024-09-19T05:40:46.834061+0000","last_fullsized":"2024-09-19T05:40:46.834061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:46.833964+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:46.833964+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.833964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.020109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:12.207171+0000","last_change":"2024-09-19T05:37:48.362326+0000","last_active":"2024-09-19T05:40:12.207171+0000","last_peered":"2024-09-19T05:40:12.207171+0000","last_clean":"2024-09-19T05:40:12.207171+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:40:12.207171+0000","last_undegraded":"2024-09-19T05:40:12.207171+0000","last_fullsized":"2024-09-19T05:40:12.207171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.860304+0000","last_change":"2024-09-19T05:40:41.860335+0000","last_active":"2024-09-19T05:40:41.860304+0000","last_peered":"2024-09-19T05:40:41.860304+0000","last_clean":"2024-09-19T05:40:41.860304+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:40:41.860304+0000","last_undegraded":"2024-09-19T05:40:41.860304+0000","last_fullsized":"2024-09-19T05:40:41.860304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-19T05:40:41.860211+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-19T05:40:41.860211+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.860211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:25.015403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.491578+0000","last_change":"2024-09-19T05:40:45.491628+0000","last_active":"2024-09-19T05:40:45.491578+0000","last_peered":"2024-09-19T05:40:45.491578+0000","last_clean":"2024-09-19T05:40:45.491578+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:40:45.491578+0000","last_undegraded":"2024-09-19T05:40:45.491578+0000","last_fullsized":"2024-09-19T05:40:45.491578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:45.491452+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:45.491452+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.491452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:25.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.663345+0000","last_change":"2024-09-19T05:40:48.663375+0000","last_active":"2024-09-19T05:40:48.663345+0000","last_peered":"2024-09-19T05:40:48.663345+0000","last_clean":"2024-09-19T05:40:48.663345+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:40:48.663345+0000","last_undegraded":"2024-09-19T05:40:48.663345+0000","last_fullsized":"2024-09-19T05:40:48.663345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.663233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.663233+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.663233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:52.172136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'20","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.485112+0000","last_change":"2024-09-19T05:40:44.485171+0000","last_active":"2024-09-19T05:40:44.485112+0000","last_peered":"2024-09-19T05:40:44.485112+0000","last_clean":"2024-09-19T05:40:44.485112+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:40:44.485112+0000","last_undegraded":"2024-09-19T05:40:44.485112+0000","last_fullsized":"2024-09-19T05:40:44.485112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-19T05:40:44.485004+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-19T05:40:44.485004+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.485004+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:14.773651+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:51.275691+0000","last_change":"2024-09-19T05:40:51.275733+0000","last_active":"2024-09-19T05:40:51.275691+0000","last_peered":"2024-09-19T05:40:51.275691+0000","last_clean":"2024-09-19T05:40:51.275691+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:40:51.275691+0000","last_undegraded":"2024-09-19T05:40:51.275691+0000","last_fullsized":"2024-09-19T05:40:51.275691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:51.275574+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:51.275574+0000","last_clean_scrub_stamp":"2024-09-19T05:40:51.275574+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:26.644369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.570552+0000","last_change":"2024-09-19T05:40:43.570578+0000","last_active":"2024-09-19T05:40:43.570552+0000","last_peered":"2024-09-19T05:40:43.570552+0000","last_clean":"2024-09-19T05:40:43.570552+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:40:43.570552+0000","last_undegraded":"2024-09-19T05:40:43.570552+0000","last_fullsized":"2024-09-19T05:40:43.570552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:43.570466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:43.570466+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.570466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:57.013082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.476986+0000","last_change":"2024-09-19T05:40:45.477042+0000","last_active":"2024-09-19T05:40:45.476986+0000","last_peered":"2024-09-19T05:40:45.476986+0000","last_clean":"2024-09-19T05:40:45.476986+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:40:45.476986+0000","last_undegraded":"2024-09-19T05:40:45.476986+0000","last_fullsized":"2024-09-19T05:40:45.476986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.476880+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.476880+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.476880+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.336882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.289894+0000","last_change":"2024-09-19T05:40:49.289922+0000","last_active":"2024-09-19T05:40:49.289894+0000","last_peered":"2024-09-19T05:40:49.289894+0000","last_clean":"2024-09-19T05:40:49.289894+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:40:49.289894+0000","last_undegraded":"2024-09-19T05:40:49.289894+0000","last_fullsized":"2024-09-19T05:40:49.289894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:49.289811+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:49.289811+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.289811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:53.892745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.618458+0000","last_change":"2024-09-19T05:40:45.618482+0000","last_active":"2024-09-19T05:40:45.618458+0000","last_peered":"2024-09-19T05:40:45.618458+0000","last_clean":"2024-09-19T05:40:45.618458+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:40:45.618458+0000","last_undegraded":"2024-09-19T05:40:45.618458+0000","last_fullsized":"2024-09-19T05:40:45.618458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:45.618376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:45.618376+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.618376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:39.232104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.536089+0000","last_change":"2024-09-19T05:40:41.536113+0000","last_active":"2024-09-19T05:40:41.536089+0000","last_peered":"2024-09-19T05:40:41.536089+0000","last_clean":"2024-09-19T05:40:41.536089+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:40:41.536089+0000","last_undegraded":"2024-09-19T05:40:41.536089+0000","last_fullsized":"2024-09-19T05:40:41.536089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:41.536006+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:41.536006+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.536006+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:36.773234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.495279+0000","last_change":"2024-09-19T05:40:41.495313+0000","last_active":"2024-09-19T05:40:41.495279+0000","last_peered":"2024-09-19T05:40:41.495279+0000","last_clean":"2024-09-19T05:40:41.495279+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:40:41.495279+0000","last_undegraded":"2024-09-19T05:40:41.495279+0000","last_fullsized":"2024-09-19T05:40:41.495279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:41.495199+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:41.495199+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.495199+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:21.468793+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.606002+0000","last_change":"2024-09-19T05:40:41.606030+0000","last_active":"2024-09-19T05:40:41.606002+0000","last_peered":"2024-09-19T05:40:41.606002+0000","last_clean":"2024-09-19T05:40:41.606002+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:40:41.606002+0000","last_undegraded":"2024-09-19T05:40:41.606002+0000","last_fullsized":"2024-09-19T05:40:41.606002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:41.605912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:41.605912+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.605912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:24.520845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.850343+0000","last_change":"2024-09-19T05:40:45.850370+0000","last_active":"2024-09-19T05:40:45.850343+0000","last_peered":"2024-09-19T05:40:45.850343+0000","last_clean":"2024-09-19T05:40:45.850343+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:40:45.850343+0000","last_undegraded":"2024-09-19T05:40:45.850343+0000","last_fullsized":"2024-09-19T05:40:45.850343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.850254+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.850254+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.850254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:27.261227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.293263+0000","last_change":"2024-09-19T05:40:38.293309+0000","last_active":"2024-09-19T05:40:38.293263+0000","last_peered":"2024-09-19T05:40:38.293263+0000","last_clean":"2024-09-19T05:40:38.293263+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:40:38.293263+0000","last_undegraded":"2024-09-19T05:40:38.293263+0000","last_fullsized":"2024-09-19T05:40:38.293263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:38.293148+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:38.293148+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.293148+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:51.034570+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.582253+0000","last_change":"2024-09-19T05:40:44.582278+0000","last_active":"2024-09-19T05:40:44.582253+0000","last_peered":"2024-09-19T05:40:44.582253+0000","last_clean":"2024-09-19T05:40:44.582253+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:40:44.582253+0000","last_undegraded":"2024-09-19T05:40:44.582253+0000","last_fullsized":"2024-09-19T05:40:44.582253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:44.582171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:44.582171+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.582171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:51.323662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.854445+0000","last_change":"2024-09-19T05:40:43.854492+0000","last_active":"2024-09-19T05:40:43.854445+0000","last_peered":"2024-09-19T05:40:43.854445+0000","last_clean":"2024-09-19T05:40:43.854445+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:40:43.854445+0000","last_undegraded":"2024-09-19T05:40:43.854445+0000","last_fullsized":"2024-09-19T05:40:43.854445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:43.854345+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:43.854345+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.854345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:15.098765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.261180+0000","last_change":"2024-09-19T05:40:36.261226+0000","last_active":"2024-09-19T05:40:36.261180+0000","last_peered":"2024-09-19T05:40:36.261180+0000","last_clean":"2024-09-19T05:40:36.261180+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:40:36.261180+0000","last_undegraded":"2024-09-19T05:40:36.261180+0000","last_fullsized":"2024-09-19T05:40:36.261180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:36.261074+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:36.261074+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.261074+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:21.584645+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.445409+0000","last_change":"2024-09-19T05:40:50.445437+0000","last_active":"2024-09-19T05:40:50.445409+0000","last_peered":"2024-09-19T05:40:50.445409+0000","last_clean":"2024-09-19T05:40:50.445409+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:40:50.445409+0000","last_undegraded":"2024-09-19T05:40:50.445409+0000","last_fullsized":"2024-09-19T05:40:50.445409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.445324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.445324+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.445324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:03.324354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.516471+0000","last_change":"2024-09-19T05:40:38.516499+0000","last_active":"2024-09-19T05:40:38.516471+0000","last_peered":"2024-09-19T05:40:38.516471+0000","last_clean":"2024-09-19T05:40:38.516471+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:40:38.516471+0000","last_undegraded":"2024-09-19T05:40:38.516471+0000","last_fullsized":"2024-09-19T05:40:38.516471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-19T05:40:38.516390+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-19T05:40:38.516390+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.516390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:06.150826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.473440+0000","last_change":"2024-09-19T05:40:42.473469+0000","last_active":"2024-09-19T05:40:42.473440+0000","last_peered":"2024-09-19T05:40:42.473440+0000","last_clean":"2024-09-19T05:40:42.473440+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:40:42.473440+0000","last_undegraded":"2024-09-19T05:40:42.473440+0000","last_fullsized":"2024-09-19T05:40:42.473440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-19T05:40:42.473357+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-19T05:40:42.473357+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.473357+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:27.778852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.696067+0000","last_change":"2024-09-19T05:40:47.696093+0000","last_active":"2024-09-19T05:40:47.696067+0000","last_peered":"2024-09-19T05:40:47.696067+0000","last_clean":"2024-09-19T05:40:47.696067+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:40:47.696067+0000","last_undegraded":"2024-09-19T05:40:47.696067+0000","last_fullsized":"2024-09-19T05:40:47.696067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.695971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.695971+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.695971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:21.040086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.491495+0000","last_change":"2024-09-19T05:40:41.491539+0000","last_active":"2024-09-19T05:40:41.491495+0000","last_peered":"2024-09-19T05:40:41.491495+0000","last_clean":"2024-09-19T05:40:41.491495+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:40:41.491495+0000","last_undegraded":"2024-09-19T05:40:41.491495+0000","last_fullsized":"2024-09-19T05:40:41.491495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:41.491409+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:41.491409+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.491409+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:11.202533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.434171+0000","last_change":"2024-09-19T05:40:36.434212+0000","last_active":"2024-09-19T05:40:36.434171+0000","last_peered":"2024-09-19T05:40:36.434171+0000","last_clean":"2024-09-19T05:40:36.434171+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:40:36.434171+0000","last_undegraded":"2024-09-19T05:40:36.434171+0000","last_fullsized":"2024-09-19T05:40:36.434171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-19T05:40:36.434077+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-19T05:40:36.434077+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.434077+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:04.490226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.666714+0000","last_change":"2024-09-19T05:40:49.666741+0000","last_active":"2024-09-19T05:40:49.666714+0000","last_peered":"2024-09-19T05:40:49.666714+0000","last_clean":"2024-09-19T05:40:49.666714+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:40:49.666714+0000","last_undegraded":"2024-09-19T05:40:49.666714+0000","last_fullsized":"2024-09-19T05:40:49.666714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.666620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.666620+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.666620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:12.632616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.855229+0000","last_change":"2024-09-19T05:40:42.855261+0000","last_active":"2024-09-19T05:40:42.855229+0000","last_peered":"2024-09-19T05:40:42.855229+0000","last_clean":"2024-09-19T05:40:42.855229+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:40:42.855229+0000","last_undegraded":"2024-09-19T05:40:42.855229+0000","last_fullsized":"2024-09-19T05:40:42.855229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:42.855116+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:42.855116+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.855116+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:59.466998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'19","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.302020+0000","last_change":"2024-09-19T05:40:35.302048+0000","last_active":"2024-09-19T05:40:35.302020+0000","last_peered":"2024-09-19T05:40:35.302020+0000","last_clean":"2024-09-19T05:40:35.302020+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:40:35.302020+0000","last_undegraded":"2024-09-19T05:40:35.302020+0000","last_fullsized":"2024-09-19T05:40:35.302020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-19T05:40:35.301955+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-19T05:40:35.301955+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.301955+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:35.483660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:47.204248+0000","last_change":"2024-09-19T05:38:26.696320+0000","last_active":"2024-09-19T05:39:47.204248+0000","last_peered":"2024-09-19T05:39:47.204248+0000","last_clean":"2024-09-19T05:39:47.204248+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:39:47.204248+0000","last_undegraded":"2024-09-19T05:39:47.204248+0000","last_fullsized":"2024-09-19T05:39:47.204248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.301826+0000","last_change":"2024-09-19T05:40:42.301861+0000","last_active":"2024-09-19T05:40:42.301826+0000","last_peered":"2024-09-19T05:40:42.301826+0000","last_clean":"2024-09-19T05:40:42.301826+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:40:42.301826+0000","last_undegraded":"2024-09-19T05:40:42.301826+0000","last_fullsized":"2024-09-19T05:40:42.301826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:42.301733+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:42.301733+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.301733+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:46.238470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.510078+0000","last_change":"2024-09-19T05:40:43.510126+0000","last_active":"2024-09-19T05:40:43.510078+0000","last_peered":"2024-09-19T05:40:43.510078+0000","last_clean":"2024-09-19T05:40:43.510078+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:40:43.510078+0000","last_undegraded":"2024-09-19T05:40:43.510078+0000","last_fullsized":"2024-09-19T05:40:43.510078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:43.509990+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:43.509990+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.509990+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:27.249283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.531190+0000","last_change":"2024-09-19T05:40:48.531238+0000","last_active":"2024-09-19T05:40:48.531190+0000","last_peered":"2024-09-19T05:40:48.531190+0000","last_clean":"2024-09-19T05:40:48.531190+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:40:48.531190+0000","last_undegraded":"2024-09-19T05:40:48.531190+0000","last_fullsized":"2024-09-19T05:40:48.531190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.531101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.531101+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.531101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:35.233846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.267542+0000","last_change":"2024-09-19T05:40:44.267569+0000","last_active":"2024-09-19T05:40:44.267542+0000","last_peered":"2024-09-19T05:40:44.267542+0000","last_clean":"2024-09-19T05:40:44.267542+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:40:44.267542+0000","last_undegraded":"2024-09-19T05:40:44.267542+0000","last_fullsized":"2024-09-19T05:40:44.267542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:44.267440+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:44.267440+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.267440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:35.479814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.302640+0000","last_change":"2024-09-19T05:40:39.302668+0000","last_active":"2024-09-19T05:40:39.302640+0000","last_peered":"2024-09-19T05:40:39.302640+0000","last_clean":"2024-09-19T05:40:39.302640+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:40:39.302640+0000","last_undegraded":"2024-09-19T05:40:39.302640+0000","last_fullsized":"2024-09-19T05:40:39.302640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-09-19T05:40:39.302546+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-09-19T05:40:39.302546+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.302546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:34.674427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.443224+0000","last_change":"2024-09-19T05:40:49.443252+0000","last_active":"2024-09-19T05:40:49.443224+0000","last_peered":"2024-09-19T05:40:49.443224+0000","last_clean":"2024-09-19T05:40:49.443224+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:40:49.443224+0000","last_undegraded":"2024-09-19T05:40:49.443224+0000","last_fullsized":"2024-09-19T05:40:49.443224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.443113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.443113+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.443113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:59.657010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.563876+0000","last_change":"2024-09-19T05:40:39.563904+0000","last_active":"2024-09-19T05:40:39.563876+0000","last_peered":"2024-09-19T05:40:39.563876+0000","last_clean":"2024-09-19T05:40:39.563876+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:40:39.563876+0000","last_undegraded":"2024-09-19T05:40:39.563876+0000","last_fullsized":"2024-09-19T05:40:39.563876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:39.563774+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:39.563774+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.563774+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:47.322364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.332600+0000","last_change":"2024-09-19T05:40:38.332638+0000","last_active":"2024-09-19T05:40:38.332600+0000","last_peered":"2024-09-19T05:40:38.332600+0000","last_clean":"2024-09-19T05:40:38.332600+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:40:38.332600+0000","last_undegraded":"2024-09-19T05:40:38.332600+0000","last_fullsized":"2024-09-19T05:40:38.332600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:38.332505+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:38.332505+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.332505+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:57.010781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.445741+0000","last_change":"2024-09-19T05:40:48.445766+0000","last_active":"2024-09-19T05:40:48.445741+0000","last_peered":"2024-09-19T05:40:48.445741+0000","last_clean":"2024-09-19T05:40:48.445741+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:40:48.445741+0000","last_undegraded":"2024-09-19T05:40:48.445741+0000","last_fullsized":"2024-09-19T05:40:48.445741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.445630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.445630+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.445630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:10.581303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.383526+0000","last_change":"2024-09-19T05:40:45.383566+0000","last_active":"2024-09-19T05:40:45.383526+0000","last_peered":"2024-09-19T05:40:45.383526+0000","last_clean":"2024-09-19T05:40:45.383526+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:40:45.383526+0000","last_undegraded":"2024-09-19T05:40:45.383526+0000","last_fullsized":"2024-09-19T05:40:45.383526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.383414+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.383414+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.383414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:52.749272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'13","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.709600+0000","last_change":"2024-09-19T05:40:37.709627+0000","last_active":"2024-09-19T05:40:37.709600+0000","last_peered":"2024-09-19T05:40:37.709600+0000","last_clean":"2024-09-19T05:40:37.709600+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:40:37.709600+0000","last_undegraded":"2024-09-19T05:40:37.709600+0000","last_fullsized":"2024-09-19T05:40:37.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-09-19T05:40:37.709536+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-09-19T05:40:37.709536+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.709536+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:26.961186+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.410126+0000","last_change":"2024-09-19T05:40:47.410151+0000","last_active":"2024-09-19T05:40:47.410126+0000","last_peered":"2024-09-19T05:40:47.410126+0000","last_clean":"2024-09-19T05:40:47.410126+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:40:47.410126+0000","last_undegraded":"2024-09-19T05:40:47.410126+0000","last_fullsized":"2024-09-19T05:40:47.410126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.410027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.410027+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.410027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:48.881101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.471376+0000","last_change":"2024-09-19T05:40:43.471403+0000","last_active":"2024-09-19T05:40:43.471376+0000","last_peered":"2024-09-19T05:40:43.471376+0000","last_clean":"2024-09-19T05:40:43.471376+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:40:43.471376+0000","last_undegraded":"2024-09-19T05:40:43.471376+0000","last_fullsized":"2024-09-19T05:40:43.471376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:43.471279+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:43.471279+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.471279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:00.563704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.501001+0000","last_change":"2024-09-19T05:40:40.501032+0000","last_active":"2024-09-19T05:40:40.501001+0000","last_peered":"2024-09-19T05:40:40.501001+0000","last_clean":"2024-09-19T05:40:40.501001+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:40:40.501001+0000","last_undegraded":"2024-09-19T05:40:40.501001+0000","last_fullsized":"2024-09-19T05:40:40.501001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:40.500922+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:40.500922+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.500922+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:18:28.153721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.484511+0000","last_change":"2024-09-19T05:40:50.484546+0000","last_active":"2024-09-19T05:40:50.484511+0000","last_peered":"2024-09-19T05:40:50.484511+0000","last_clean":"2024-09-19T05:40:50.484511+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:40:50.484511+0000","last_undegraded":"2024-09-19T05:40:50.484511+0000","last_fullsized":"2024-09-19T05:40:50.484511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.484406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.484406+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.484406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:57.911980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.785714+0000","last_change":"2024-09-19T05:40:47.785739+0000","last_active":"2024-09-19T05:40:47.785714+0000","last_peered":"2024-09-19T05:40:47.785714+0000","last_clean":"2024-09-19T05:40:47.785714+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:40:47.785714+0000","last_undegraded":"2024-09-19T05:40:47.785714+0000","last_fullsized":"2024-09-19T05:40:47.785714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:47.785616+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:47.785616+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.785616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:53.664695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.330007+0000","last_change":"2024-09-19T05:40:39.330049+0000","last_active":"2024-09-19T05:40:39.330007+0000","last_peered":"2024-09-19T05:40:39.330007+0000","last_clean":"2024-09-19T05:40:39.330007+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:40:39.330007+0000","last_undegraded":"2024-09-19T05:40:39.330007+0000","last_fullsized":"2024-09-19T05:40:39.330007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:39.329923+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:39.329923+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.329923+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:46.105565+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.507572+0000","last_change":"2024-09-19T05:40:39.507621+0000","last_active":"2024-09-19T05:40:39.507572+0000","last_peered":"2024-09-19T05:40:39.507572+0000","last_clean":"2024-09-19T05:40:39.507572+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:40:39.507572+0000","last_undegraded":"2024-09-19T05:40:39.507572+0000","last_fullsized":"2024-09-19T05:40:39.507572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-09-19T05:40:39.507488+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-09-19T05:40:39.507488+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.507488+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:08.513098+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.427070+0000","last_change":"2024-09-19T05:40:47.427094+0000","last_active":"2024-09-19T05:40:47.427070+0000","last_peered":"2024-09-19T05:40:47.427070+0000","last_clean":"2024-09-19T05:40:47.427070+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:40:47.427070+0000","last_undegraded":"2024-09-19T05:40:47.427070+0000","last_fullsized":"2024-09-19T05:40:47.427070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.426987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.426987+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.426987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:58.307098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.759184+0000","last_change":"2024-09-19T05:37:43.800252+0000","last_active":"2024-09-19T05:40:24.759184+0000","last_peered":"2024-09-19T05:40:24.759184+0000","last_clean":"2024-09-19T05:40:24.759184+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:40:24.759184+0000","last_undegraded":"2024-09-19T05:40:24.759184+0000","last_fullsized":"2024-09-19T05:40:24.759184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'9","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.690065+0000","last_change":"2024-09-19T05:40:36.690093+0000","last_active":"2024-09-19T05:40:36.690065+0000","last_peered":"2024-09-19T05:40:36.690065+0000","last_clean":"2024-09-19T05:40:36.690065+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:40:36.690065+0000","last_undegraded":"2024-09-19T05:40:36.690065+0000","last_fullsized":"2024-09-19T05:40:36.690065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:36.689994+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:36.689994+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.689994+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:07.484014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.444409+0000","last_change":"2024-09-19T05:40:49.444441+0000","last_active":"2024-09-19T05:40:49.444409+0000","last_peered":"2024-09-19T05:40:49.444409+0000","last_clean":"2024-09-19T05:40:49.444409+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:40:49.444409+0000","last_undegraded":"2024-09-19T05:40:49.444409+0000","last_fullsized":"2024-09-19T05:40:49.444409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.444302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.444302+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.444302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:18.147987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.407542+0000","last_change":"2024-09-19T05:40:36.407599+0000","last_active":"2024-09-19T05:40:36.407542+0000","last_peered":"2024-09-19T05:40:36.407542+0000","last_clean":"2024-09-19T05:40:36.407542+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:40:36.407542+0000","last_undegraded":"2024-09-19T05:40:36.407542+0000","last_fullsized":"2024-09-19T05:40:36.407542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:36.407434+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:36.407434+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.407434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:30.430330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.288437+0000","last_change":"2024-09-19T05:40:37.288476+0000","last_active":"2024-09-19T05:40:37.288437+0000","last_peered":"2024-09-19T05:40:37.288437+0000","last_clean":"2024-09-19T05:40:37.288437+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:40:37.288437+0000","last_undegraded":"2024-09-19T05:40:37.288437+0000","last_fullsized":"2024-09-19T05:40:37.288437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:37.288360+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:37.288360+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.288360+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:55.255400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.506451+0000","last_change":"2024-09-19T05:40:46.506483+0000","last_active":"2024-09-19T05:40:46.506451+0000","last_peered":"2024-09-19T05:40:46.506451+0000","last_clean":"2024-09-19T05:40:46.506451+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:40:46.506451+0000","last_undegraded":"2024-09-19T05:40:46.506451+0000","last_fullsized":"2024-09-19T05:40:46.506451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:46.506363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:46.506363+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.506363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:36.842989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:51.431402+0000","last_change":"2024-09-19T05:40:51.431444+0000","last_active":"2024-09-19T05:40:51.431402+0000","last_peered":"2024-09-19T05:40:51.431402+0000","last_clean":"2024-09-19T05:40:51.431402+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:40:51.431402+0000","last_undegraded":"2024-09-19T05:40:51.431402+0000","last_fullsized":"2024-09-19T05:40:51.431402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:51.431306+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:51.431306+0000","last_clean_scrub_stamp":"2024-09-19T05:40:51.431306+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:36.487974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'7","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.694580+0000","last_change":"2024-09-19T05:40:38.694618+0000","last_active":"2024-09-19T05:40:38.694580+0000","last_peered":"2024-09-19T05:40:38.694580+0000","last_clean":"2024-09-19T05:40:38.694580+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:40:38.694580+0000","last_undegraded":"2024-09-19T05:40:38.694580+0000","last_fullsized":"2024-09-19T05:40:38.694580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:38.694476+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:38.694476+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.694476+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:45.226431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:39:57.209701+0000","last_change":"2024-09-19T05:37:48.362985+0000","last_active":"2024-09-19T05:39:57.209701+0000","last_peered":"2024-09-19T05:39:57.209701+0000","last_clean":"2024-09-19T05:39:57.209701+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:39:57.209701+0000","last_undegraded":"2024-09-19T05:39:57.209701+0000","last_fullsized":"2024-09-19T05:39:57.209701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758810+0000","last_change":"2024-09-19T05:37:43.801963+0000","last_active":"2024-09-19T05:40:24.758810+0000","last_peered":"2024-09-19T05:40:24.758810+0000","last_clean":"2024-09-19T05:40:24.758810+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:40:24.758810+0000","last_undegraded":"2024-09-19T05:40:24.758810+0000","last_fullsized":"2024-09-19T05:40:24.758810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.567822+0000","last_change":"2024-09-19T05:40:35.567859+0000","last_active":"2024-09-19T05:40:35.567822+0000","last_peered":"2024-09-19T05:40:35.567822+0000","last_clean":"2024-09-19T05:40:35.567822+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:40:35.567822+0000","last_undegraded":"2024-09-19T05:40:35.567822+0000","last_fullsized":"2024-09-19T05:40:35.567822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:35.567731+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:35.567731+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.567731+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:44.712577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.657522+0000","last_change":"2024-09-19T05:40:46.657548+0000","last_active":"2024-09-19T05:40:46.657522+0000","last_peered":"2024-09-19T05:40:46.657522+0000","last_clean":"2024-09-19T05:40:46.657522+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:40:46.657522+0000","last_undegraded":"2024-09-19T05:40:46.657522+0000","last_fullsized":"2024-09-19T05:40:46.657522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:46.657412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:46.657412+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.657412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:46.002977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.458809+0000","last_change":"2024-09-19T05:40:48.458839+0000","last_active":"2024-09-19T05:40:48.458809+0000","last_peered":"2024-09-19T05:40:48.458809+0000","last_clean":"2024-09-19T05:40:48.458809+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:40:48.458809+0000","last_undegraded":"2024-09-19T05:40:48.458809+0000","last_fullsized":"2024-09-19T05:40:48.458809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:48.458714+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:48.458714+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.458714+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:19.006219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'26","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.654026+0000","last_change":"2024-09-19T05:40:35.654064+0000","last_active":"2024-09-19T05:40:35.654026+0000","last_peered":"2024-09-19T05:40:35.654026+0000","last_clean":"2024-09-19T05:40:35.654026+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:40:35.654026+0000","last_undegraded":"2024-09-19T05:40:35.654026+0000","last_fullsized":"2024-09-19T05:40:35.654026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2024-09-19T05:40:35.653955+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2024-09-19T05:40:35.653955+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.653955+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:51.016229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.502379+0000","last_change":"2024-09-19T05:40:47.502406+0000","last_active":"2024-09-19T05:40:47.502379+0000","last_peered":"2024-09-19T05:40:47.502379+0000","last_clean":"2024-09-19T05:40:47.502379+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:40:47.502379+0000","last_undegraded":"2024-09-19T05:40:47.502379+0000","last_fullsized":"2024-09-19T05:40:47.502379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.502292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.502292+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.502292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:15.218420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.480247+0000","last_change":"2024-09-19T05:40:43.480274+0000","last_active":"2024-09-19T05:40:43.480247+0000","last_peered":"2024-09-19T05:40:43.480247+0000","last_clean":"2024-09-19T05:40:43.480247+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:40:43.480247+0000","last_undegraded":"2024-09-19T05:40:43.480247+0000","last_fullsized":"2024-09-19T05:40:43.480247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:43.480160+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:43.480160+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.480160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:23.473541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.451395+0000","last_change":"2024-09-19T05:40:37.451427+0000","last_active":"2024-09-19T05:40:37.451395+0000","last_peered":"2024-09-19T05:40:37.451395+0000","last_clean":"2024-09-19T05:40:37.451395+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:40:37.451395+0000","last_undegraded":"2024-09-19T05:40:37.451395+0000","last_fullsized":"2024-09-19T05:40:37.451395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:37.451288+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:37.451288+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.451288+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:42.362036+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.869233+0000","last_change":"2024-09-19T05:40:50.869285+0000","last_active":"2024-09-19T05:40:50.869233+0000","last_peered":"2024-09-19T05:40:50.869233+0000","last_clean":"2024-09-19T05:40:50.869233+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:40:50.869233+0000","last_undegraded":"2024-09-19T05:40:50.869233+0000","last_fullsized":"2024-09-19T05:40:50.869233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.869132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.869132+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.869132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:23.412793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.450934+0000","last_change":"2024-09-19T05:40:47.450959+0000","last_active":"2024-09-19T05:40:47.450934+0000","last_peered":"2024-09-19T05:40:47.450934+0000","last_clean":"2024-09-19T05:40:47.450934+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:40:47.450934+0000","last_undegraded":"2024-09-19T05:40:47.450934+0000","last_fullsized":"2024-09-19T05:40:47.450934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:47.450848+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:47.450848+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.450848+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:51.354956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.279250+0000","last_change":"2024-09-19T05:40:42.279280+0000","last_active":"2024-09-19T05:40:42.279250+0000","last_peered":"2024-09-19T05:40:42.279250+0000","last_clean":"2024-09-19T05:40:42.279250+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:40:42.279250+0000","last_undegraded":"2024-09-19T05:40:42.279250+0000","last_fullsized":"2024-09-19T05:40:42.279250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:42.279169+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:42.279169+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.279169+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:09.432691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:51.827948+0000","last_change":"2024-09-19T05:40:51.827977+0000","last_active":"2024-09-19T05:40:51.827948+0000","last_peered":"2024-09-19T05:40:51.827948+0000","last_clean":"2024-09-19T05:40:51.827948+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:40:51.827948+0000","last_undegraded":"2024-09-19T05:40:51.827948+0000","last_fullsized":"2024-09-19T05:40:51.827948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:51.827834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:51.827834+0000","last_clean_scrub_stamp":"2024-09-19T05:40:51.827834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:48.535168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.512999+0000","last_change":"2024-09-19T05:40:37.513033+0000","last_active":"2024-09-19T05:40:37.512999+0000","last_peered":"2024-09-19T05:40:37.512999+0000","last_clean":"2024-09-19T05:40:37.512999+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:40:37.512999+0000","last_undegraded":"2024-09-19T05:40:37.512999+0000","last_fullsized":"2024-09-19T05:40:37.512999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:37.512925+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:37.512925+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.512925+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:23.535615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'15","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.483136+0000","last_change":"2024-09-19T05:40:36.483169+0000","last_active":"2024-09-19T05:40:36.483136+0000","last_peered":"2024-09-19T05:40:36.483136+0000","last_clean":"2024-09-19T05:40:36.483136+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:40:36.483136+0000","last_undegraded":"2024-09-19T05:40:36.483136+0000","last_fullsized":"2024-09-19T05:40:36.483136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:36.483071+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:36.483071+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.483071+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:54.776731+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:12.211812+0000","last_change":"2024-09-19T05:37:48.360330+0000","last_active":"2024-09-19T05:40:12.211812+0000","last_peered":"2024-09-19T05:40:12.211812+0000","last_clean":"2024-09-19T05:40:12.211812+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:40:12.211812+0000","last_undegraded":"2024-09-19T05:40:12.211812+0000","last_fullsized":"2024-09-19T05:40:12.211812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.468128+0000","last_change":"2024-09-19T05:40:46.468169+0000","last_active":"2024-09-19T05:40:46.468128+0000","last_peered":"2024-09-19T05:40:46.468128+0000","last_clean":"2024-09-19T05:40:46.468128+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:40:46.468128+0000","last_undegraded":"2024-09-19T05:40:46.468128+0000","last_fullsized":"2024-09-19T05:40:46.468128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:46.468025+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:46.468025+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.468025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:26.420568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.493070+0000","last_change":"2024-09-19T05:40:40.493109+0000","last_active":"2024-09-19T05:40:40.493070+0000","last_peered":"2024-09-19T05:40:40.493070+0000","last_clean":"2024-09-19T05:40:40.493070+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:40:40.493070+0000","last_undegraded":"2024-09-19T05:40:40.493070+0000","last_fullsized":"2024-09-19T05:40:40.493070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2024-09-19T05:40:40.492979+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2024-09-19T05:40:40.492979+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.492979+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:57.763050+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.361915+0000","last_change":"2024-09-19T05:40:46.361973+0000","last_active":"2024-09-19T05:40:46.361915+0000","last_peered":"2024-09-19T05:40:46.361915+0000","last_clean":"2024-09-19T05:40:46.361915+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:40:46.361915+0000","last_undegraded":"2024-09-19T05:40:46.361915+0000","last_fullsized":"2024-09-19T05:40:46.361915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-19T05:40:46.361812+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-19T05:40:46.361812+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.361812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:05.391467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.530516+0000","last_change":"2024-09-19T05:40:36.530555+0000","last_active":"2024-09-19T05:40:36.530516+0000","last_peered":"2024-09-19T05:40:36.530516+0000","last_clean":"2024-09-19T05:40:36.530516+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:40:36.530516+0000","last_undegraded":"2024-09-19T05:40:36.530516+0000","last_fullsized":"2024-09-19T05:40:36.530516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:36.530434+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:36.530434+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.530434+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:37.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.294221+0000","last_change":"2024-09-19T05:40:40.294273+0000","last_active":"2024-09-19T05:40:40.294221+0000","last_peered":"2024-09-19T05:40:40.294221+0000","last_clean":"2024-09-19T05:40:40.294221+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:40:40.294221+0000","last_undegraded":"2024-09-19T05:40:40.294221+0000","last_fullsized":"2024-09-19T05:40:40.294221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-19T05:40:40.294109+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-19T05:40:40.294109+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.294109+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.089697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.583828+0000","last_change":"2024-09-19T05:40:42.583870+0000","last_active":"2024-09-19T05:40:42.583828+0000","last_peered":"2024-09-19T05:40:42.583828+0000","last_clean":"2024-09-19T05:40:42.583828+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:40:42.583828+0000","last_undegraded":"2024-09-19T05:40:42.583828+0000","last_fullsized":"2024-09-19T05:40:42.583828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:42.583712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:42.583712+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.583712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:03.181590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.483911+0000","last_change":"2024-09-19T05:40:44.483951+0000","last_active":"2024-09-19T05:40:44.483911+0000","last_peered":"2024-09-19T05:40:44.483911+0000","last_clean":"2024-09-19T05:40:44.483911+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:40:44.483911+0000","last_undegraded":"2024-09-19T05:40:44.483911+0000","last_fullsized":"2024-09-19T05:40:44.483911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:44.483801+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:44.483801+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.483801+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:56.363906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.333820+0000","last_change":"2024-09-19T05:40:40.333851+0000","last_active":"2024-09-19T05:40:40.333820+0000","last_peered":"2024-09-19T05:40:40.333820+0000","last_clean":"2024-09-19T05:40:40.333820+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:40:40.333820+0000","last_undegraded":"2024-09-19T05:40:40.333820+0000","last_fullsized":"2024-09-19T05:40:40.333820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:40.333719+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:40.333719+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.333719+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:58.788782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.816990+0000","last_change":"2024-09-19T05:40:48.817016+0000","last_active":"2024-09-19T05:40:48.816990+0000","last_peered":"2024-09-19T05:40:48.816990+0000","last_clean":"2024-09-19T05:40:48.816990+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:40:48.816990+0000","last_undegraded":"2024-09-19T05:40:48.816990+0000","last_fullsized":"2024-09-19T05:40:48.816990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.816881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.816881+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.816881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:40.593112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.668488+0000","last_change":"2024-09-19T05:40:43.668488+0000","last_active":"2024-09-19T05:40:43.668488+0000","last_peered":"2024-09-19T05:40:43.668488+0000","last_clean":"2024-09-19T05:40:43.668488+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:40:43.668488+0000","last_undegraded":"2024-09-19T05:40:43.668488+0000","last_fullsized":"2024-09-19T05:40:43.668488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:43.668321+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:43.668321+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.668321+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.950937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.445084+0000","last_change":"2024-09-19T05:40:39.445118+0000","last_active":"2024-09-19T05:40:39.445084+0000","last_peered":"2024-09-19T05:40:39.445084+0000","last_clean":"2024-09-19T05:40:39.445084+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:40:39.445084+0000","last_undegraded":"2024-09-19T05:40:39.445084+0000","last_fullsized":"2024-09-19T05:40:39.445084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:39.444995+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:39.444995+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.444995+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:43.454680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:07.206677+0000","last_change":"2024-09-19T05:37:48.361390+0000","last_active":"2024-09-19T05:40:07.206677+0000","last_peered":"2024-09-19T05:40:07.206677+0000","last_clean":"2024-09-19T05:40:07.206677+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:40:07.206677+0000","last_undegraded":"2024-09-19T05:40:07.206677+0000","last_fullsized":"2024-09-19T05:40:07.206677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:46.791011+0000","last_clean_scrub_stamp":"2024-09-19T05:37:46.791011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.520970+0000","last_change":"2024-09-19T05:40:49.520996+0000","last_active":"2024-09-19T05:40:49.520970+0000","last_peered":"2024-09-19T05:40:49.520970+0000","last_clean":"2024-09-19T05:40:49.520970+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:40:49.520970+0000","last_undegraded":"2024-09-19T05:40:49.520970+0000","last_fullsized":"2024-09-19T05:40:49.520970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.520883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.520883+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.520883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:44.734662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.309128+0000","last_change":"2024-09-19T05:40:43.309178+0000","last_active":"2024-09-19T05:40:43.309128+0000","last_peered":"2024-09-19T05:40:43.309128+0000","last_clean":"2024-09-19T05:40:43.309128+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:40:43.309128+0000","last_undegraded":"2024-09-19T05:40:43.309128+0000","last_fullsized":"2024-09-19T05:40:43.309128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:43.309019+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:43.309019+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.309019+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:07.438318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.295945+0000","last_change":"2024-09-19T05:40:41.295979+0000","last_active":"2024-09-19T05:40:41.295945+0000","last_peered":"2024-09-19T05:40:41.295945+0000","last_clean":"2024-09-19T05:40:41.295945+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:40:41.295945+0000","last_undegraded":"2024-09-19T05:40:41.295945+0000","last_fullsized":"2024-09-19T05:40:41.295945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:41.295859+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:41.295859+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.295859+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:42.833900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.477804+0000","last_change":"2024-09-19T05:40:50.477847+0000","last_active":"2024-09-19T05:40:50.477804+0000","last_peered":"2024-09-19T05:40:50.477804+0000","last_clean":"2024-09-19T05:40:50.477804+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:40:50.477804+0000","last_undegraded":"2024-09-19T05:40:50.477804+0000","last_fullsized":"2024-09-19T05:40:50.477804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.477672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.477672+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.477672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:44.488643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.842792+0000","last_change":"2024-09-19T05:40:36.842813+0000","last_active":"2024-09-19T05:40:36.842792+0000","last_peered":"2024-09-19T05:40:36.842792+0000","last_clean":"2024-09-19T05:40:36.842792+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:40:36.842792+0000","last_undegraded":"2024-09-19T05:40:36.842792+0000","last_fullsized":"2024-09-19T05:40:36.842792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:36.842725+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:36.842725+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.842725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:31.777186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.827951+0000","last_change":"2024-09-19T05:40:40.827984+0000","last_active":"2024-09-19T05:40:40.827951+0000","last_peered":"2024-09-19T05:40:40.827951+0000","last_clean":"2024-09-19T05:40:40.827951+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:40:40.827951+0000","last_undegraded":"2024-09-19T05:40:40.827951+0000","last_fullsized":"2024-09-19T05:40:40.827951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:40.827867+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:40.827867+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.827867+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:57.855764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.483925+0000","last_change":"2024-09-19T05:40:38.483955+0000","last_active":"2024-09-19T05:40:38.483925+0000","last_peered":"2024-09-19T05:40:38.483925+0000","last_clean":"2024-09-19T05:40:38.483925+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:40:38.483925+0000","last_undegraded":"2024-09-19T05:40:38.483925+0000","last_fullsized":"2024-09-19T05:40:38.483925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:38.483842+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:38.483842+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.483842+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:03.253962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.488353+0000","last_change":"2024-09-19T05:40:42.488396+0000","last_active":"2024-09-19T05:40:42.488353+0000","last_peered":"2024-09-19T05:40:42.488353+0000","last_clean":"2024-09-19T05:40:42.488353+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:40:42.488353+0000","last_undegraded":"2024-09-19T05:40:42.488353+0000","last_fullsized":"2024-09-19T05:40:42.488353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:42.488247+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:42.488247+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.488247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.052872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.637362+0000","last_change":"2024-09-19T05:40:40.637386+0000","last_active":"2024-09-19T05:40:40.637362+0000","last_peered":"2024-09-19T05:40:40.637362+0000","last_clean":"2024-09-19T05:40:40.637362+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:40:40.637362+0000","last_undegraded":"2024-09-19T05:40:40.637362+0000","last_fullsized":"2024-09-19T05:40:40.637362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:40.637271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:40.637271+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.637271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:53.417043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.860243+0000","last_change":"2024-09-19T05:40:39.860280+0000","last_active":"2024-09-19T05:40:39.860243+0000","last_peered":"2024-09-19T05:40:39.860243+0000","last_clean":"2024-09-19T05:40:39.860243+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:40:39.860243+0000","last_undegraded":"2024-09-19T05:40:39.860243+0000","last_fullsized":"2024-09-19T05:40:39.860243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:39.860156+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:39.860156+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.860156+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:51.799282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1206,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.542460+0000","last_change":"2024-09-19T05:40:37.542486+0000","last_active":"2024-09-19T05:40:37.542460+0000","last_peered":"2024-09-19T05:40:37.542460+0000","last_clean":"2024-09-19T05:40:37.542460+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:40:37.542460+0000","last_undegraded":"2024-09-19T05:40:37.542460+0000","last_fullsized":"2024-09-19T05:40:37.542460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:37.542380+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:37.542380+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.542380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:14.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.827262+0000","last_change":"2024-09-19T05:40:49.827309+0000","last_active":"2024-09-19T05:40:49.827262+0000","last_peered":"2024-09-19T05:40:49.827262+0000","last_clean":"2024-09-19T05:40:49.827262+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:40:49.827262+0000","last_undegraded":"2024-09-19T05:40:49.827262+0000","last_fullsized":"2024-09-19T05:40:49.827262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.827141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.827141+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.827141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:58.457521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.465036+0000","last_change":"2024-09-19T05:40:44.465067+0000","last_active":"2024-09-19T05:40:44.465036+0000","last_peered":"2024-09-19T05:40:44.465036+0000","last_clean":"2024-09-19T05:40:44.465036+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:40:44.465036+0000","last_undegraded":"2024-09-19T05:40:44.465036+0000","last_fullsized":"2024-09-19T05:40:44.465036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:44.464938+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:44.464938+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.464938+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:21.676807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.706855+0000","last_change":"2024-09-19T05:40:42.706899+0000","last_active":"2024-09-19T05:40:42.706855+0000","last_peered":"2024-09-19T05:40:42.706855+0000","last_clean":"2024-09-19T05:40:42.706855+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:40:42.706855+0000","last_undegraded":"2024-09-19T05:40:42.706855+0000","last_fullsized":"2024-09-19T05:40:42.706855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-19T05:40:42.706752+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-19T05:40:42.706752+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.706752+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:57.945004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.378933+0000","last_change":"2024-09-19T05:40:37.378977+0000","last_active":"2024-09-19T05:40:37.378933+0000","last_peered":"2024-09-19T05:40:37.378933+0000","last_clean":"2024-09-19T05:40:37.378933+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:40:37.378933+0000","last_undegraded":"2024-09-19T05:40:37.378933+0000","last_fullsized":"2024-09-19T05:40:37.378933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:37.378833+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:37.378833+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.378833+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:07.583591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:34.447005+0000","last_change":"2024-09-19T05:40:34.447027+0000","last_active":"2024-09-19T05:40:34.447005+0000","last_peered":"2024-09-19T05:40:34.447005+0000","last_clean":"2024-09-19T05:40:34.447005+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:40:34.447005+0000","last_undegraded":"2024-09-19T05:40:34.447005+0000","last_fullsized":"2024-09-19T05:40:34.447005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:34.446941+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:34.446941+0000","last_clean_scrub_stamp":"2024-09-19T05:40:34.446941+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:52.636285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.660306+0000","last_change":"2024-09-19T05:40:41.660335+0000","last_active":"2024-09-19T05:40:41.660306+0000","last_peered":"2024-09-19T05:40:41.660306+0000","last_clean":"2024-09-19T05:40:41.660306+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:40:41.660306+0000","last_undegraded":"2024-09-19T05:40:41.660306+0000","last_fullsized":"2024-09-19T05:40:41.660306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:41.660219+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:41.660219+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.660219+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:25.520396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.296496+0000","last_change":"2024-09-19T05:40:41.296532+0000","last_active":"2024-09-19T05:40:41.296496+0000","last_peered":"2024-09-19T05:40:41.296496+0000","last_clean":"2024-09-19T05:40:41.296496+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:40:41.296496+0000","last_undegraded":"2024-09-19T05:40:41.296496+0000","last_fullsized":"2024-09-19T05:40:41.296496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:41.296406+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:41.296406+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.296406+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:58:10.042153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.465814+0000","last_change":"2024-09-19T05:40:45.465840+0000","last_active":"2024-09-19T05:40:45.465814+0000","last_peered":"2024-09-19T05:40:45.465814+0000","last_clean":"2024-09-19T05:40:45.465814+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:40:45.465814+0000","last_undegraded":"2024-09-19T05:40:45.465814+0000","last_fullsized":"2024-09-19T05:40:45.465814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:45.465727+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:45.465727+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.465727+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:52.868140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.823903+0000","last_change":"2024-09-19T05:40:37.823927+0000","last_active":"2024-09-19T05:40:37.823903+0000","last_peered":"2024-09-19T05:40:37.823903+0000","last_clean":"2024-09-19T05:40:37.823903+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:40:37.823903+0000","last_undegraded":"2024-09-19T05:40:37.823903+0000","last_fullsized":"2024-09-19T05:40:37.823903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-19T05:40:37.823835+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-19T05:40:37.823835+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.823835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:28.474776+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.233056+0000","last_change":"2024-09-19T05:40:43.233084+0000","last_active":"2024-09-19T05:40:43.233056+0000","last_peered":"2024-09-19T05:40:43.233056+0000","last_clean":"2024-09-19T05:40:43.233056+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:40:43.233056+0000","last_undegraded":"2024-09-19T05:40:43.233056+0000","last_fullsized":"2024-09-19T05:40:43.233056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:43.232970+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:43.232970+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.232970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:51:11.938943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.850443+0000","last_change":"2024-09-19T05:40:38.850497+0000","last_active":"2024-09-19T05:40:38.850443+0000","last_peered":"2024-09-19T05:40:38.850443+0000","last_clean":"2024-09-19T05:40:38.850443+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:40:38.850443+0000","last_undegraded":"2024-09-19T05:40:38.850443+0000","last_fullsized":"2024-09-19T05:40:38.850443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:38.850347+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:38.850347+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.850347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:25.632460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.340105+0000","last_change":"2024-09-19T05:40:47.340133+0000","last_active":"2024-09-19T05:40:47.340105+0000","last_peered":"2024-09-19T05:40:47.340105+0000","last_clean":"2024-09-19T05:40:47.340105+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:40:47.340105+0000","last_undegraded":"2024-09-19T05:40:47.340105+0000","last_fullsized":"2024-09-19T05:40:47.340105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:47.339994+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:47.339994+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.339994+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:58.719832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.539483+0000","last_change":"2024-09-19T05:40:38.539543+0000","last_active":"2024-09-19T05:40:38.539483+0000","last_peered":"2024-09-19T05:40:38.539483+0000","last_clean":"2024-09-19T05:40:38.539483+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:40:38.539483+0000","last_undegraded":"2024-09-19T05:40:38.539483+0000","last_fullsized":"2024-09-19T05:40:38.539483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:38.539360+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:38.539360+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.539360+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:22.660026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.495348+0000","last_change":"2024-09-19T05:40:42.495373+0000","last_active":"2024-09-19T05:40:42.495348+0000","last_peered":"2024-09-19T05:40:42.495348+0000","last_clean":"2024-09-19T05:40:42.495348+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:40:42.495348+0000","last_undegraded":"2024-09-19T05:40:42.495348+0000","last_fullsized":"2024-09-19T05:40:42.495348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:42.495262+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:42.495262+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.495262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:19.532105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.432270+0000","last_change":"2024-09-19T05:40:49.432296+0000","last_active":"2024-09-19T05:40:49.432270+0000","last_peered":"2024-09-19T05:40:49.432270+0000","last_clean":"2024-09-19T05:40:49.432270+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:40:49.432270+0000","last_undegraded":"2024-09-19T05:40:49.432270+0000","last_fullsized":"2024-09-19T05:40:49.432270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:49.432189+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:49.432189+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.432189+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:19.107028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.664608+0000","last_change":"2024-09-19T05:40:39.664636+0000","last_active":"2024-09-19T05:40:39.664608+0000","last_peered":"2024-09-19T05:40:39.664608+0000","last_clean":"2024-09-19T05:40:39.664608+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:40:39.664608+0000","last_undegraded":"2024-09-19T05:40:39.664608+0000","last_fullsized":"2024-09-19T05:40:39.664608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:39.664527+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:39.664527+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.664527+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:13.084376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.305875+0000","last_change":"2024-09-19T05:40:46.305902+0000","last_active":"2024-09-19T05:40:46.305875+0000","last_peered":"2024-09-19T05:40:46.305875+0000","last_clean":"2024-09-19T05:40:46.305875+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:40:46.305875+0000","last_undegraded":"2024-09-19T05:40:46.305875+0000","last_fullsized":"2024-09-19T05:40:46.305875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:46.305776+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:46.305776+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.305776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:53.242870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.296668+0000","last_change":"2024-09-19T05:40:48.296699+0000","last_active":"2024-09-19T05:40:48.296668+0000","last_peered":"2024-09-19T05:40:48.296668+0000","last_clean":"2024-09-19T05:40:48.296668+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:40:48.296668+0000","last_undegraded":"2024-09-19T05:40:48.296668+0000","last_fullsized":"2024-09-19T05:40:48.296668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:48.296581+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:48.296581+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.296581+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:58.116000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:34.260251+0000","last_change":"2024-09-19T05:40:34.260275+0000","last_active":"2024-09-19T05:40:34.260251+0000","last_peered":"2024-09-19T05:40:34.260251+0000","last_clean":"2024-09-19T05:40:34.260251+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:40:34.260251+0000","last_undegraded":"2024-09-19T05:40:34.260251+0000","last_fullsized":"2024-09-19T05:40:34.260251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:34.260181+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:34.260181+0000","last_clean_scrub_stamp":"2024-09-19T05:40:34.260181+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:22.732175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.497435+0000","last_change":"2024-09-19T05:40:39.497467+0000","last_active":"2024-09-19T05:40:39.497435+0000","last_peered":"2024-09-19T05:40:39.497435+0000","last_clean":"2024-09-19T05:40:39.497435+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:40:39.497435+0000","last_undegraded":"2024-09-19T05:40:39.497435+0000","last_fullsized":"2024-09-19T05:40:39.497435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:39.497339+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:39.497339+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.497339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.207008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.859702+0000","last_change":"2024-09-19T05:40:35.859744+0000","last_active":"2024-09-19T05:40:35.859702+0000","last_peered":"2024-09-19T05:40:35.859702+0000","last_clean":"2024-09-19T05:40:35.859702+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:40:35.859702+0000","last_undegraded":"2024-09-19T05:40:35.859702+0000","last_fullsized":"2024-09-19T05:40:35.859702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:35.859620+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:35.859620+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.859620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:00.570464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.608973+0000","last_change":"2024-09-19T05:40:40.608998+0000","last_active":"2024-09-19T05:40:40.608973+0000","last_peered":"2024-09-19T05:40:40.608973+0000","last_clean":"2024-09-19T05:40:40.608973+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:40:40.608973+0000","last_undegraded":"2024-09-19T05:40:40.608973+0000","last_fullsized":"2024-09-19T05:40:40.608973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:40.608893+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:40.608893+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.608893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:34.743578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.472748+0000","last_change":"2024-09-19T05:40:48.472792+0000","last_active":"2024-09-19T05:40:48.472748+0000","last_peered":"2024-09-19T05:40:48.472748+0000","last_clean":"2024-09-19T05:40:48.472748+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:40:48.472748+0000","last_undegraded":"2024-09-19T05:40:48.472748+0000","last_fullsized":"2024-09-19T05:40:48.472748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:48.472603+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:48.472603+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.472603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:36.427411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.460191+0000","last_change":"2024-09-19T05:40:46.460216+0000","last_active":"2024-09-19T05:40:46.460191+0000","last_peered":"2024-09-19T05:40:46.460191+0000","last_clean":"2024-09-19T05:40:46.460191+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:40:46.460191+0000","last_undegraded":"2024-09-19T05:40:46.460191+0000","last_fullsized":"2024-09-19T05:40:46.460191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-19T05:40:46.460109+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-19T05:40:46.460109+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.460109+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:27.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:24.758628+0000","last_change":"2024-09-19T05:37:43.799422+0000","last_active":"2024-09-19T05:40:24.758628+0000","last_peered":"2024-09-19T05:40:24.758628+0000","last_clean":"2024-09-19T05:40:24.758628+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:40:24.758628+0000","last_undegraded":"2024-09-19T05:40:24.758628+0000","last_fullsized":"2024-09-19T05:40:24.758628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:37:42.765668+0000","last_clean_scrub_stamp":"2024-09-19T05:37:42.765668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.870018+0000","last_change":"2024-09-19T05:40:44.870043+0000","last_active":"2024-09-19T05:40:44.870018+0000","last_peered":"2024-09-19T05:40:44.870018+0000","last_clean":"2024-09-19T05:40:44.870018+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:40:44.870018+0000","last_undegraded":"2024-09-19T05:40:44.870018+0000","last_fullsized":"2024-09-19T05:40:44.870018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:44.869931+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:44.869931+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.869931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:18.243679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.415050+0000","last_change":"2024-09-19T05:40:50.415079+0000","last_active":"2024-09-19T05:40:50.415050+0000","last_peered":"2024-09-19T05:40:50.415050+0000","last_clean":"2024-09-19T05:40:50.415050+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:40:50.415050+0000","last_undegraded":"2024-09-19T05:40:50.415050+0000","last_fullsized":"2024-09-19T05:40:50.415050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:50.414969+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:50.414969+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.414969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:51.581914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.276819+0000","last_change":"2024-09-19T05:40:50.276848+0000","last_active":"2024-09-19T05:40:50.276819+0000","last_peered":"2024-09-19T05:40:50.276819+0000","last_clean":"2024-09-19T05:40:50.276819+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:40:50.276819+0000","last_undegraded":"2024-09-19T05:40:50.276819+0000","last_fullsized":"2024-09-19T05:40:50.276819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:50.276727+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:50.276727+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.276727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:18.165102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.480445+0000","last_change":"2024-09-19T05:40:37.480504+0000","last_active":"2024-09-19T05:40:37.480445+0000","last_peered":"2024-09-19T05:40:37.480445+0000","last_clean":"2024-09-19T05:40:37.480445+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:40:37.480445+0000","last_undegraded":"2024-09-19T05:40:37.480445+0000","last_fullsized":"2024-09-19T05:40:37.480445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:37.480323+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:37.480323+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.480323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:09.215908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.301337+0000","last_change":"2024-09-19T05:40:45.301379+0000","last_active":"2024-09-19T05:40:45.301337+0000","last_peered":"2024-09-19T05:40:45.301337+0000","last_clean":"2024-09-19T05:40:45.301337+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:40:45.301337+0000","last_undegraded":"2024-09-19T05:40:45.301337+0000","last_fullsized":"2024-09-19T05:40:45.301337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.301213+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.301213+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.301213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:22.704675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.479842+0000","last_change":"2024-09-19T05:40:40.479866+0000","last_active":"2024-09-19T05:40:40.479842+0000","last_peered":"2024-09-19T05:40:40.479842+0000","last_clean":"2024-09-19T05:40:40.479842+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:40:40.479842+0000","last_undegraded":"2024-09-19T05:40:40.479842+0000","last_fullsized":"2024-09-19T05:40:40.479842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:40.479748+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:40.479748+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.479748+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.847272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.345364+0000","last_change":"2024-09-19T05:40:44.345394+0000","last_active":"2024-09-19T05:40:44.345364+0000","last_peered":"2024-09-19T05:40:44.345364+0000","last_clean":"2024-09-19T05:40:44.345364+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:40:44.345364+0000","last_undegraded":"2024-09-19T05:40:44.345364+0000","last_fullsized":"2024-09-19T05:40:44.345364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:44.345273+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:44.345273+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.345273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:07.294573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.522039+0000","last_change":"2024-09-19T05:40:38.522073+0000","last_active":"2024-09-19T05:40:38.522039+0000","last_peered":"2024-09-19T05:40:38.522039+0000","last_clean":"2024-09-19T05:40:38.522039+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:40:38.522039+0000","last_undegraded":"2024-09-19T05:40:38.522039+0000","last_fullsized":"2024-09-19T05:40:38.522039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:38.521941+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:38.521941+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.521941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:04.126972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49294,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":264,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":98588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718685,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":167715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":168161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":128091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":42528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:40:57.466 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.466 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.467 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.467 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.467 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.468 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.468 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T05:37:46.791011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=46, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.468 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T05:37:42.765668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=37, tm_sec=42, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=5, tm_min=40, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T05:40:57.469 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T05:41:13.108 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:13.111 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:17.470 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:41:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.579+0000 7fed35de8640 1 Processor -- start 2024-09-19T05:41:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.579+0000 7fed35de8640 1 -- start start 2024-09-19T05:41:17.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.579+0000 7fed35de8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fed30151ea0 0x7fed300c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.579+0000 7fed35de8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fed300c3a50 0x7fed3006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.579+0000 7fed35de8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3015bc80 con 0x7fed300c46c0 2024-09-19T05:41:17.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.579+0000 7fed35de8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fed301585a0 con 0x7fed30151ea0 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.579+0000 7fed35de8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fed30157c70 con 0x7fed300c3a50 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fed30151ea0 0x7fed300c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fed30151ea0 0x7fed300c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36956/0 (socket says 172.21.15.103:36956) 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2effd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fed300c46c0 0x7fed30158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56586/0 (socket says 172.21.15.103:56586) 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2f7fe640 1 -- 172.21.15.103:0/32531963 learned_addr learned my addr 172.21.15.103:0/32531963 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2ffff640 1 --2- 172.21.15.103:0/32531963 >> v2:172.21.15.174:3300/0 conn(0x7fed300c3a50 0x7fed3006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2f7fe640 1 -- 172.21.15.103:0/32531963 >> v2:172.21.15.174:3300/0 conn(0x7fed300c3a50 msgr2=0x7fed3006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2f7fe640 1 --2- 172.21.15.103:0/32531963 >> v2:172.21.15.174:3300/0 conn(0x7fed300c3a50 0x7fed3006eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2f7fe640 1 -- 172.21.15.103:0/32531963 >> v1:172.21.15.103:6789/0 conn(0x7fed300c46c0 legacy=0x7fed30158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2f7fe640 1 -- 172.21.15.103:0/32531963 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed30157f50 con 0x7fed30151ea0 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.580+0000 7fed2ffff640 1 --2- 172.21.15.103:0/32531963 >> v2:172.21.15.174:3300/0 conn(0x7fed300c3a50 0x7fed3006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed2f7fe640 1 --2- 172.21.15.103:0/32531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30151ea0 0x7fed300c89b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fed3006fcf0 tx=0x7fed2002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2550ede53442f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:17.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed2e7fc640 1 -- 172.21.15.103:0/32531963 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20037070 con 0x7fed30151ea0 2024-09-19T05:41:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed2e7fc640 1 -- 172.21.15.103:0/32531963 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2002ae50 con 0x7fed30151ea0 2024-09-19T05:41:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed2e7fc640 1 -- 172.21.15.103:0/32531963 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20032860 con 0x7fed30151ea0 2024-09-19T05:41:17.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed35de8640 1 -- 172.21.15.103:0/32531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30151ea0 msgr2=0x7fed300c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed35de8640 1 --2- 172.21.15.103:0/32531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30151ea0 0x7fed300c89b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fed3006fcf0 tx=0x7fed2002a300 comp rx=0 tx=0).stop 2024-09-19T05:41:17.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed35de8640 1 -- 172.21.15.103:0/32531963 shutdown_connections 2024-09-19T05:41:17.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed35de8640 1 --2- 172.21.15.103:0/32531963 >> v2:172.21.15.174:3300/0 conn(0x7fed300c3a50 0x7fed3006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed35de8640 1 --2- 172.21.15.103:0/32531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed30151ea0 0x7fed300c89b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed35de8640 1 -- 172.21.15.103:0/32531963 >> 172.21.15.103:0/32531963 conn(0x7fed300c9230 msgr2=0x7fed300c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.581+0000 7fed35de8640 1 -- 172.21.15.103:0/32531963 shutdown_connections 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.582+0000 7fed35de8640 1 -- 172.21.15.103:0/32531963 wait complete. 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.583+0000 7fed35de8640 1 Processor -- start 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.583+0000 7fed35de8640 1 -- start start 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed300c3a50 0x7fed301573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed300c46c0 0x7fed301ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed30151ea0 0x7fed30156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed301596e0 con 0x7fed300c46c0 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed30152280 con 0x7fed300c3a50 2024-09-19T05:41:17.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fed30158a30 con 0x7fed30151ea0 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed300c46c0 0x7fed301ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed300c46c0 0x7fed301ed6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36968/0 (socket says 172.21.15.103:36968) 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 -- 172.21.15.103:0/1874841826 learned_addr learned my addr 172.21.15.103:0/1874841826 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2f7fe640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed300c3a50 0x7fed301573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2ffff640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed30151ea0 0x7fed30156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 -- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed30151ea0 msgr2=0x7fed30156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed30151ea0 0x7fed30156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 -- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed300c3a50 msgr2=0x7fed301573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed300c3a50 0x7fed301573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 -- 172.21.15.103:0/1874841826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed30152570 con 0x7fed300c46c0 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2f7fe640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed300c3a50 0x7fed301573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2ffff640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed30151ea0 0x7fed30156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:17.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed2effd640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed300c46c0 0x7fed301ed6e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c430 tx=0x7fed1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed27fff640 1 -- 172.21.15.103:0/1874841826 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed180074e0 con 0x7fed300c46c0 2024-09-19T05:41:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed27fff640 1 -- 172.21.15.103:0/1874841826 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed18007680 con 0x7fed300c46c0 2024-09-19T05:41:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed30152850 con 0x7fed300c46c0 2024-09-19T05:41:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed27fff640 1 -- 172.21.15.103:0/1874841826 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18004a00 con 0x7fed300c46c0 2024-09-19T05:41:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.584+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed300c8a80 con 0x7fed300c46c0 2024-09-19T05:41:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.586+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3015bf20 con 0x7fed300c46c0 2024-09-19T05:41:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.586+0000 7fed27fff640 1 -- 172.21.15.103:0/1874841826 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed1801a020 con 0x7fed300c46c0 2024-09-19T05:41:17.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.586+0000 7fed27fff640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fed1006c2b0 0x7fed1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.587+0000 7fed27fff640 1 -- 172.21.15.103:0/1874841826 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fed1808b040 con 0x7fed300c46c0 2024-09-19T05:41:17.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.587+0000 7fed2f7fe640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fed1006c2b0 0x7fed1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.587+0000 7fed2f7fe640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fed1006c2b0 0x7fed1006e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed20034000 tx=0x7fed2002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:17.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.591+0000 7fed27fff640 1 -- 172.21.15.103:0/1874841826 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fed180593b0 con 0x7fed300c46c0 2024-09-19T05:41:17.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.755+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 --> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed301510c0 con 0x7fed1006c2b0 2024-09-19T05:41:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.763+0000 7fed27fff640 1 -- 172.21.15.103:0/1874841826 <== mgr.4107 v2:172.21.15.103:6832/2804194317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333122 (secure 0 0 0) 0x7fed301510c0 con 0x7fed1006c2b0 2024-09-19T05:41:17.769 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:41:17.772 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-19T05:41:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fed1006c2b0 msgr2=0x7fed1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fed1006c2b0 0x7fed1006e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed20034000 tx=0x7fed2002e000 comp rx=0 tx=0).stop 2024-09-19T05:41:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed300c46c0 msgr2=0x7fed301ed6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed300c46c0 0x7fed301ed6e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c430 tx=0x7fed1800c8f0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 shutdown_connections 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fed1006c2b0 0x7fed1006e770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed30151ea0 0x7fed30156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed300c46c0 0x7fed301ed6e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 --2- 172.21.15.103:0/1874841826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed300c3a50 0x7fed301573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 >> 172.21.15.103:0/1874841826 conn(0x7fed300c9230 msgr2=0x7fed3014d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 shutdown_connections 2024-09-19T05:41:17.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.767+0000 7fed35de8640 1 -- 172.21.15.103:0/1874841826 wait complete. 2024-09-19T05:41:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-19T05:41:16.232050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639662,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":425,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":949,"ondisk_log_size":949,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2867200,"data_stored":2284388,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003178"},"pg_stats":[{"pgid":"2.1f","version":"28'19","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.446423+0000","last_change":"2024-09-19T05:40:35.446455+0000","last_active":"2024-09-19T05:40:35.446423+0000","last_peered":"2024-09-19T05:40:35.446423+0000","last_clean":"2024-09-19T05:40:35.446423+0000","last_became_active":"2024-09-19T05:37:42.782757+0000","last_became_peered":"2024-09-19T05:37:42.782757+0000","last_unstale":"2024-09-19T05:40:35.446423+0000","last_undegraded":"2024-09-19T05:40:35.446423+0000","last_fullsized":"2024-09-19T05:40:35.446423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-19T05:40:35.446360+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-19T05:40:35.446360+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.446360+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:12.720036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.834061+0000","last_change":"2024-09-19T05:40:46.834106+0000","last_active":"2024-09-19T05:40:46.834061+0000","last_peered":"2024-09-19T05:40:46.834061+0000","last_clean":"2024-09-19T05:40:46.834061+0000","last_became_active":"2024-09-19T05:37:43.793142+0000","last_became_peered":"2024-09-19T05:37:43.793142+0000","last_unstale":"2024-09-19T05:40:46.834061+0000","last_undegraded":"2024-09-19T05:40:46.834061+0000","last_fullsized":"2024-09-19T05:40:46.834061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:46.833964+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:46.833964+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.833964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.020109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:53.765456+0000","last_change":"2024-09-19T05:40:53.765496+0000","last_active":"2024-09-19T05:40:53.765456+0000","last_peered":"2024-09-19T05:40:53.765456+0000","last_clean":"2024-09-19T05:40:53.765456+0000","last_became_active":"2024-09-19T05:37:48.360958+0000","last_became_peered":"2024-09-19T05:37:48.360958+0000","last_unstale":"2024-09-19T05:40:53.765456+0000","last_undegraded":"2024-09-19T05:40:53.765456+0000","last_fullsized":"2024-09-19T05:40:53.765456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:53.765334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:53.765334+0000","last_clean_scrub_stamp":"2024-09-19T05:40:53.765334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:02.925144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.860304+0000","last_change":"2024-09-19T05:40:41.860335+0000","last_active":"2024-09-19T05:40:41.860304+0000","last_peered":"2024-09-19T05:40:41.860304+0000","last_clean":"2024-09-19T05:40:41.860304+0000","last_became_active":"2024-09-19T05:37:42.797076+0000","last_became_peered":"2024-09-19T05:37:42.797076+0000","last_unstale":"2024-09-19T05:40:41.860304+0000","last_undegraded":"2024-09-19T05:40:41.860304+0000","last_fullsized":"2024-09-19T05:40:41.860304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-09-19T05:40:41.860211+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-09-19T05:40:41.860211+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.860211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:25.015403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.491578+0000","last_change":"2024-09-19T05:40:45.491628+0000","last_active":"2024-09-19T05:40:45.491578+0000","last_peered":"2024-09-19T05:40:45.491578+0000","last_clean":"2024-09-19T05:40:45.491578+0000","last_became_active":"2024-09-19T05:37:43.800315+0000","last_became_peered":"2024-09-19T05:37:43.800315+0000","last_unstale":"2024-09-19T05:40:45.491578+0000","last_undegraded":"2024-09-19T05:40:45.491578+0000","last_fullsized":"2024-09-19T05:40:45.491578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:45.491452+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:45.491452+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.491452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:25.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.663345+0000","last_change":"2024-09-19T05:40:48.663375+0000","last_active":"2024-09-19T05:40:48.663345+0000","last_peered":"2024-09-19T05:40:48.663345+0000","last_clean":"2024-09-19T05:40:48.663345+0000","last_became_active":"2024-09-19T05:37:47.823762+0000","last_became_peered":"2024-09-19T05:37:47.823762+0000","last_unstale":"2024-09-19T05:40:48.663345+0000","last_undegraded":"2024-09-19T05:40:48.663345+0000","last_fullsized":"2024-09-19T05:40:48.663345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.663233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.663233+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.663233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:52.172136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'20","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.485112+0000","last_change":"2024-09-19T05:40:44.485171+0000","last_active":"2024-09-19T05:40:44.485112+0000","last_peered":"2024-09-19T05:40:44.485112+0000","last_clean":"2024-09-19T05:40:44.485112+0000","last_became_active":"2024-09-19T05:37:42.790404+0000","last_became_peered":"2024-09-19T05:37:42.790404+0000","last_unstale":"2024-09-19T05:40:44.485112+0000","last_undegraded":"2024-09-19T05:40:44.485112+0000","last_fullsized":"2024-09-19T05:40:44.485112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-19T05:40:44.485004+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-19T05:40:44.485004+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.485004+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:14.773651+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:51.275691+0000","last_change":"2024-09-19T05:40:51.275733+0000","last_active":"2024-09-19T05:40:51.275691+0000","last_peered":"2024-09-19T05:40:51.275691+0000","last_clean":"2024-09-19T05:40:51.275691+0000","last_became_active":"2024-09-19T05:37:43.799665+0000","last_became_peered":"2024-09-19T05:37:43.799665+0000","last_unstale":"2024-09-19T05:40:51.275691+0000","last_undegraded":"2024-09-19T05:40:51.275691+0000","last_fullsized":"2024-09-19T05:40:51.275691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:51.275574+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:51.275574+0000","last_clean_scrub_stamp":"2024-09-19T05:40:51.275574+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:26.644369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.570552+0000","last_change":"2024-09-19T05:40:43.570578+0000","last_active":"2024-09-19T05:40:43.570552+0000","last_peered":"2024-09-19T05:40:43.570552+0000","last_clean":"2024-09-19T05:40:43.570552+0000","last_became_active":"2024-09-19T05:37:47.815266+0000","last_became_peered":"2024-09-19T05:37:47.815266+0000","last_unstale":"2024-09-19T05:40:43.570552+0000","last_undegraded":"2024-09-19T05:40:43.570552+0000","last_fullsized":"2024-09-19T05:40:43.570552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:43.570466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:43.570466+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.570466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:57.013082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.476986+0000","last_change":"2024-09-19T05:40:45.477042+0000","last_active":"2024-09-19T05:40:45.476986+0000","last_peered":"2024-09-19T05:40:45.476986+0000","last_clean":"2024-09-19T05:40:45.476986+0000","last_became_active":"2024-09-19T05:37:42.791073+0000","last_became_peered":"2024-09-19T05:37:42.791073+0000","last_unstale":"2024-09-19T05:40:45.476986+0000","last_undegraded":"2024-09-19T05:40:45.476986+0000","last_fullsized":"2024-09-19T05:40:45.476986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.476880+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.476880+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.476880+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:47.336882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.289894+0000","last_change":"2024-09-19T05:40:49.289922+0000","last_active":"2024-09-19T05:40:49.289894+0000","last_peered":"2024-09-19T05:40:49.289894+0000","last_clean":"2024-09-19T05:40:49.289894+0000","last_became_active":"2024-09-19T05:37:43.799604+0000","last_became_peered":"2024-09-19T05:37:43.799604+0000","last_unstale":"2024-09-19T05:40:49.289894+0000","last_undegraded":"2024-09-19T05:40:49.289894+0000","last_fullsized":"2024-09-19T05:40:49.289894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:49.289811+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:49.289811+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.289811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:53.892745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.618458+0000","last_change":"2024-09-19T05:40:45.618482+0000","last_active":"2024-09-19T05:40:45.618458+0000","last_peered":"2024-09-19T05:40:45.618458+0000","last_clean":"2024-09-19T05:40:45.618458+0000","last_became_active":"2024-09-19T05:37:47.815759+0000","last_became_peered":"2024-09-19T05:37:47.815759+0000","last_unstale":"2024-09-19T05:40:45.618458+0000","last_undegraded":"2024-09-19T05:40:45.618458+0000","last_fullsized":"2024-09-19T05:40:45.618458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:45.618376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:45.618376+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.618376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:53:39.232104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.536089+0000","last_change":"2024-09-19T05:40:41.536113+0000","last_active":"2024-09-19T05:40:41.536089+0000","last_peered":"2024-09-19T05:40:41.536089+0000","last_clean":"2024-09-19T05:40:41.536089+0000","last_became_active":"2024-09-19T05:37:43.788134+0000","last_became_peered":"2024-09-19T05:37:43.788134+0000","last_unstale":"2024-09-19T05:40:41.536089+0000","last_undegraded":"2024-09-19T05:40:41.536089+0000","last_fullsized":"2024-09-19T05:40:41.536089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:41.536006+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:41.536006+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.536006+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:36.773234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.495279+0000","last_change":"2024-09-19T05:40:41.495313+0000","last_active":"2024-09-19T05:40:41.495279+0000","last_peered":"2024-09-19T05:40:41.495279+0000","last_clean":"2024-09-19T05:40:41.495279+0000","last_became_active":"2024-09-19T05:37:42.788127+0000","last_became_peered":"2024-09-19T05:37:42.788127+0000","last_unstale":"2024-09-19T05:40:41.495279+0000","last_undegraded":"2024-09-19T05:40:41.495279+0000","last_fullsized":"2024-09-19T05:40:41.495279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:41.495199+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:41.495199+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.495199+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:21.468793+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.606002+0000","last_change":"2024-09-19T05:40:41.606030+0000","last_active":"2024-09-19T05:40:41.606002+0000","last_peered":"2024-09-19T05:40:41.606002+0000","last_clean":"2024-09-19T05:40:41.606002+0000","last_became_active":"2024-09-19T05:37:47.812740+0000","last_became_peered":"2024-09-19T05:37:47.812740+0000","last_unstale":"2024-09-19T05:40:41.606002+0000","last_undegraded":"2024-09-19T05:40:41.606002+0000","last_fullsized":"2024-09-19T05:40:41.606002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:41.605912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:41.605912+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.605912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:24.520845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.850343+0000","last_change":"2024-09-19T05:40:45.850370+0000","last_active":"2024-09-19T05:40:45.850343+0000","last_peered":"2024-09-19T05:40:45.850343+0000","last_clean":"2024-09-19T05:40:45.850343+0000","last_became_active":"2024-09-19T05:37:43.792419+0000","last_became_peered":"2024-09-19T05:37:43.792419+0000","last_unstale":"2024-09-19T05:40:45.850343+0000","last_undegraded":"2024-09-19T05:40:45.850343+0000","last_fullsized":"2024-09-19T05:40:45.850343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.850254+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.850254+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.850254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:27.261227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.293263+0000","last_change":"2024-09-19T05:40:38.293309+0000","last_active":"2024-09-19T05:40:38.293263+0000","last_peered":"2024-09-19T05:40:38.293263+0000","last_clean":"2024-09-19T05:40:38.293263+0000","last_became_active":"2024-09-19T05:37:42.789798+0000","last_became_peered":"2024-09-19T05:37:42.789798+0000","last_unstale":"2024-09-19T05:40:38.293263+0000","last_undegraded":"2024-09-19T05:40:38.293263+0000","last_fullsized":"2024-09-19T05:40:38.293263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:38.293148+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:38.293148+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.293148+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:51.034570+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.582253+0000","last_change":"2024-09-19T05:40:44.582278+0000","last_active":"2024-09-19T05:40:44.582253+0000","last_peered":"2024-09-19T05:40:44.582253+0000","last_clean":"2024-09-19T05:40:44.582253+0000","last_became_active":"2024-09-19T05:37:47.814497+0000","last_became_peered":"2024-09-19T05:37:47.814497+0000","last_unstale":"2024-09-19T05:40:44.582253+0000","last_undegraded":"2024-09-19T05:40:44.582253+0000","last_fullsized":"2024-09-19T05:40:44.582253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:44.582171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:44.582171+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.582171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:51.323662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.854445+0000","last_change":"2024-09-19T05:40:43.854492+0000","last_active":"2024-09-19T05:40:43.854445+0000","last_peered":"2024-09-19T05:40:43.854445+0000","last_clean":"2024-09-19T05:40:43.854445+0000","last_became_active":"2024-09-19T05:37:43.789099+0000","last_became_peered":"2024-09-19T05:37:43.789099+0000","last_unstale":"2024-09-19T05:40:43.854445+0000","last_undegraded":"2024-09-19T05:40:43.854445+0000","last_fullsized":"2024-09-19T05:40:43.854445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:43.854345+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:43.854345+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.854345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:15.098765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.261180+0000","last_change":"2024-09-19T05:40:36.261226+0000","last_active":"2024-09-19T05:40:36.261180+0000","last_peered":"2024-09-19T05:40:36.261180+0000","last_clean":"2024-09-19T05:40:36.261180+0000","last_became_active":"2024-09-19T05:37:42.786497+0000","last_became_peered":"2024-09-19T05:37:42.786497+0000","last_unstale":"2024-09-19T05:40:36.261180+0000","last_undegraded":"2024-09-19T05:40:36.261180+0000","last_fullsized":"2024-09-19T05:40:36.261180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:36.261074+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:36.261074+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.261074+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:21.584645+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.445409+0000","last_change":"2024-09-19T05:40:50.445437+0000","last_active":"2024-09-19T05:40:50.445409+0000","last_peered":"2024-09-19T05:40:50.445409+0000","last_clean":"2024-09-19T05:40:50.445409+0000","last_became_active":"2024-09-19T05:37:48.359976+0000","last_became_peered":"2024-09-19T05:37:48.359976+0000","last_unstale":"2024-09-19T05:40:50.445409+0000","last_undegraded":"2024-09-19T05:40:50.445409+0000","last_fullsized":"2024-09-19T05:40:50.445409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.445324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.445324+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.445324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:03.324354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'2","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.516471+0000","last_change":"2024-09-19T05:40:38.516499+0000","last_active":"2024-09-19T05:40:38.516471+0000","last_peered":"2024-09-19T05:40:38.516471+0000","last_clean":"2024-09-19T05:40:38.516471+0000","last_became_active":"2024-09-19T05:37:43.787430+0000","last_became_peered":"2024-09-19T05:37:43.787430+0000","last_unstale":"2024-09-19T05:40:38.516471+0000","last_undegraded":"2024-09-19T05:40:38.516471+0000","last_fullsized":"2024-09-19T05:40:38.516471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-19T05:40:38.516390+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-19T05:40:38.516390+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.516390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:06.150826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.473440+0000","last_change":"2024-09-19T05:40:42.473469+0000","last_active":"2024-09-19T05:40:42.473440+0000","last_peered":"2024-09-19T05:40:42.473440+0000","last_clean":"2024-09-19T05:40:42.473440+0000","last_became_active":"2024-09-19T05:37:42.789753+0000","last_became_peered":"2024-09-19T05:37:42.789753+0000","last_unstale":"2024-09-19T05:40:42.473440+0000","last_undegraded":"2024-09-19T05:40:42.473440+0000","last_fullsized":"2024-09-19T05:40:42.473440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-19T05:40:42.473357+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-19T05:40:42.473357+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.473357+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:27.778852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.696067+0000","last_change":"2024-09-19T05:40:47.696093+0000","last_active":"2024-09-19T05:40:47.696067+0000","last_peered":"2024-09-19T05:40:47.696067+0000","last_clean":"2024-09-19T05:40:47.696067+0000","last_became_active":"2024-09-19T05:37:47.823370+0000","last_became_peered":"2024-09-19T05:37:47.823370+0000","last_unstale":"2024-09-19T05:40:47.696067+0000","last_undegraded":"2024-09-19T05:40:47.696067+0000","last_fullsized":"2024-09-19T05:40:47.696067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.695971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.695971+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.695971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:21.040086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.491495+0000","last_change":"2024-09-19T05:40:41.491539+0000","last_active":"2024-09-19T05:40:41.491495+0000","last_peered":"2024-09-19T05:40:41.491495+0000","last_clean":"2024-09-19T05:40:41.491495+0000","last_became_active":"2024-09-19T05:37:43.793865+0000","last_became_peered":"2024-09-19T05:37:43.793865+0000","last_unstale":"2024-09-19T05:40:41.491495+0000","last_undegraded":"2024-09-19T05:40:41.491495+0000","last_fullsized":"2024-09-19T05:40:41.491495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:41.491409+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:41.491409+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.491409+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:11.202533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.434171+0000","last_change":"2024-09-19T05:40:36.434212+0000","last_active":"2024-09-19T05:40:36.434171+0000","last_peered":"2024-09-19T05:40:36.434171+0000","last_clean":"2024-09-19T05:40:36.434171+0000","last_became_active":"2024-09-19T05:37:42.782912+0000","last_became_peered":"2024-09-19T05:37:42.782912+0000","last_unstale":"2024-09-19T05:40:36.434171+0000","last_undegraded":"2024-09-19T05:40:36.434171+0000","last_fullsized":"2024-09-19T05:40:36.434171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-19T05:40:36.434077+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-19T05:40:36.434077+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.434077+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:04.490226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.666714+0000","last_change":"2024-09-19T05:40:49.666741+0000","last_active":"2024-09-19T05:40:49.666714+0000","last_peered":"2024-09-19T05:40:49.666714+0000","last_clean":"2024-09-19T05:40:49.666714+0000","last_became_active":"2024-09-19T05:37:48.359871+0000","last_became_peered":"2024-09-19T05:37:48.359871+0000","last_unstale":"2024-09-19T05:40:49.666714+0000","last_undegraded":"2024-09-19T05:40:49.666714+0000","last_fullsized":"2024-09-19T05:40:49.666714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.666620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.666620+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.666620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:12.632616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.855229+0000","last_change":"2024-09-19T05:40:42.855261+0000","last_active":"2024-09-19T05:40:42.855229+0000","last_peered":"2024-09-19T05:40:42.855229+0000","last_clean":"2024-09-19T05:40:42.855229+0000","last_became_active":"2024-09-19T05:37:43.786482+0000","last_became_peered":"2024-09-19T05:37:43.786482+0000","last_unstale":"2024-09-19T05:40:42.855229+0000","last_undegraded":"2024-09-19T05:40:42.855229+0000","last_fullsized":"2024-09-19T05:40:42.855229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:42.855116+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:42.855116+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.855116+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:59.466998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'19","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.302020+0000","last_change":"2024-09-19T05:40:35.302048+0000","last_active":"2024-09-19T05:40:35.302020+0000","last_peered":"2024-09-19T05:40:35.302020+0000","last_clean":"2024-09-19T05:40:35.302020+0000","last_became_active":"2024-09-19T05:37:42.783348+0000","last_became_peered":"2024-09-19T05:37:42.783348+0000","last_unstale":"2024-09-19T05:40:35.302020+0000","last_undegraded":"2024-09-19T05:40:35.302020+0000","last_fullsized":"2024-09-19T05:40:35.302020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-19T05:40:35.301955+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-19T05:40:35.301955+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.301955+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:35.483660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:54.782247+0000","last_change":"2024-09-19T05:40:54.782275+0000","last_active":"2024-09-19T05:40:54.782247+0000","last_peered":"2024-09-19T05:40:54.782247+0000","last_clean":"2024-09-19T05:40:54.782247+0000","last_became_active":"2024-09-19T05:38:26.695884+0000","last_became_peered":"2024-09-19T05:38:26.695884+0000","last_unstale":"2024-09-19T05:40:54.782247+0000","last_undegraded":"2024-09-19T05:40:54.782247+0000","last_fullsized":"2024-09-19T05:40:54.782247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:54.782151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:54.782151+0000","last_clean_scrub_stamp":"2024-09-19T05:40:54.782151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:28.304485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.301826+0000","last_change":"2024-09-19T05:40:42.301861+0000","last_active":"2024-09-19T05:40:42.301826+0000","last_peered":"2024-09-19T05:40:42.301826+0000","last_clean":"2024-09-19T05:40:42.301826+0000","last_became_active":"2024-09-19T05:37:43.787327+0000","last_became_peered":"2024-09-19T05:37:43.787327+0000","last_unstale":"2024-09-19T05:40:42.301826+0000","last_undegraded":"2024-09-19T05:40:42.301826+0000","last_fullsized":"2024-09-19T05:40:42.301826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:42.301733+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:42.301733+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.301733+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:46.238470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.510078+0000","last_change":"2024-09-19T05:40:43.510126+0000","last_active":"2024-09-19T05:40:43.510078+0000","last_peered":"2024-09-19T05:40:43.510078+0000","last_clean":"2024-09-19T05:40:43.510078+0000","last_became_active":"2024-09-19T05:37:42.789817+0000","last_became_peered":"2024-09-19T05:37:42.789817+0000","last_unstale":"2024-09-19T05:40:43.510078+0000","last_undegraded":"2024-09-19T05:40:43.510078+0000","last_fullsized":"2024-09-19T05:40:43.510078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:43.509990+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:43.509990+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.509990+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:27.249283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.531190+0000","last_change":"2024-09-19T05:40:48.531238+0000","last_active":"2024-09-19T05:40:48.531190+0000","last_peered":"2024-09-19T05:40:48.531190+0000","last_clean":"2024-09-19T05:40:48.531190+0000","last_became_active":"2024-09-19T05:37:48.359842+0000","last_became_peered":"2024-09-19T05:37:48.359842+0000","last_unstale":"2024-09-19T05:40:48.531190+0000","last_undegraded":"2024-09-19T05:40:48.531190+0000","last_fullsized":"2024-09-19T05:40:48.531190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.531101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.531101+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.531101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:35.233846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.267542+0000","last_change":"2024-09-19T05:40:44.267569+0000","last_active":"2024-09-19T05:40:44.267542+0000","last_peered":"2024-09-19T05:40:44.267542+0000","last_clean":"2024-09-19T05:40:44.267542+0000","last_became_active":"2024-09-19T05:37:43.796083+0000","last_became_peered":"2024-09-19T05:37:43.796083+0000","last_unstale":"2024-09-19T05:40:44.267542+0000","last_undegraded":"2024-09-19T05:40:44.267542+0000","last_fullsized":"2024-09-19T05:40:44.267542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:44.267440+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:44.267440+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.267440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:35.479814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.302640+0000","last_change":"2024-09-19T05:40:39.302668+0000","last_active":"2024-09-19T05:40:39.302640+0000","last_peered":"2024-09-19T05:40:39.302640+0000","last_clean":"2024-09-19T05:40:39.302640+0000","last_became_active":"2024-09-19T05:37:42.790200+0000","last_became_peered":"2024-09-19T05:37:42.790200+0000","last_unstale":"2024-09-19T05:40:39.302640+0000","last_undegraded":"2024-09-19T05:40:39.302640+0000","last_fullsized":"2024-09-19T05:40:39.302640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-09-19T05:40:39.302546+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-09-19T05:40:39.302546+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.302546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:34.674427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.443224+0000","last_change":"2024-09-19T05:40:49.443252+0000","last_active":"2024-09-19T05:40:49.443224+0000","last_peered":"2024-09-19T05:40:49.443224+0000","last_clean":"2024-09-19T05:40:49.443224+0000","last_became_active":"2024-09-19T05:37:47.822145+0000","last_became_peered":"2024-09-19T05:37:47.822145+0000","last_unstale":"2024-09-19T05:40:49.443224+0000","last_undegraded":"2024-09-19T05:40:49.443224+0000","last_fullsized":"2024-09-19T05:40:49.443224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.443113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.443113+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.443113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:59.657010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.563876+0000","last_change":"2024-09-19T05:40:39.563904+0000","last_active":"2024-09-19T05:40:39.563876+0000","last_peered":"2024-09-19T05:40:39.563876+0000","last_clean":"2024-09-19T05:40:39.563876+0000","last_became_active":"2024-09-19T05:37:43.789694+0000","last_became_peered":"2024-09-19T05:37:43.789694+0000","last_unstale":"2024-09-19T05:40:39.563876+0000","last_undegraded":"2024-09-19T05:40:39.563876+0000","last_fullsized":"2024-09-19T05:40:39.563876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:39.563774+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:39.563774+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.563774+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:47.322364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.332600+0000","last_change":"2024-09-19T05:40:38.332638+0000","last_active":"2024-09-19T05:40:38.332600+0000","last_peered":"2024-09-19T05:40:38.332600+0000","last_clean":"2024-09-19T05:40:38.332600+0000","last_became_active":"2024-09-19T05:37:42.787139+0000","last_became_peered":"2024-09-19T05:37:42.787139+0000","last_unstale":"2024-09-19T05:40:38.332600+0000","last_undegraded":"2024-09-19T05:40:38.332600+0000","last_fullsized":"2024-09-19T05:40:38.332600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:38.332505+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:38.332505+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.332505+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:57.010781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.445741+0000","last_change":"2024-09-19T05:40:48.445766+0000","last_active":"2024-09-19T05:40:48.445741+0000","last_peered":"2024-09-19T05:40:48.445741+0000","last_clean":"2024-09-19T05:40:48.445741+0000","last_became_active":"2024-09-19T05:37:47.821073+0000","last_became_peered":"2024-09-19T05:37:47.821073+0000","last_unstale":"2024-09-19T05:40:48.445741+0000","last_undegraded":"2024-09-19T05:40:48.445741+0000","last_fullsized":"2024-09-19T05:40:48.445741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.445630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.445630+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.445630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:10.581303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.383526+0000","last_change":"2024-09-19T05:40:45.383566+0000","last_active":"2024-09-19T05:40:45.383526+0000","last_peered":"2024-09-19T05:40:45.383526+0000","last_clean":"2024-09-19T05:40:45.383526+0000","last_became_active":"2024-09-19T05:37:43.787509+0000","last_became_peered":"2024-09-19T05:37:43.787509+0000","last_unstale":"2024-09-19T05:40:45.383526+0000","last_undegraded":"2024-09-19T05:40:45.383526+0000","last_fullsized":"2024-09-19T05:40:45.383526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.383414+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.383414+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.383414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:52.749272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'13","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.709600+0000","last_change":"2024-09-19T05:40:37.709627+0000","last_active":"2024-09-19T05:40:37.709600+0000","last_peered":"2024-09-19T05:40:37.709600+0000","last_clean":"2024-09-19T05:40:37.709600+0000","last_became_active":"2024-09-19T05:37:42.792614+0000","last_became_peered":"2024-09-19T05:37:42.792614+0000","last_unstale":"2024-09-19T05:40:37.709600+0000","last_undegraded":"2024-09-19T05:40:37.709600+0000","last_fullsized":"2024-09-19T05:40:37.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-09-19T05:40:37.709536+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-09-19T05:40:37.709536+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.709536+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:26.961186+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.410126+0000","last_change":"2024-09-19T05:40:47.410151+0000","last_active":"2024-09-19T05:40:47.410126+0000","last_peered":"2024-09-19T05:40:47.410126+0000","last_clean":"2024-09-19T05:40:47.410126+0000","last_became_active":"2024-09-19T05:37:47.820830+0000","last_became_peered":"2024-09-19T05:37:47.820830+0000","last_unstale":"2024-09-19T05:40:47.410126+0000","last_undegraded":"2024-09-19T05:40:47.410126+0000","last_fullsized":"2024-09-19T05:40:47.410126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.410027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.410027+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.410027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:48.881101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.471376+0000","last_change":"2024-09-19T05:40:43.471403+0000","last_active":"2024-09-19T05:40:43.471376+0000","last_peered":"2024-09-19T05:40:43.471376+0000","last_clean":"2024-09-19T05:40:43.471376+0000","last_became_active":"2024-09-19T05:37:43.797144+0000","last_became_peered":"2024-09-19T05:37:43.797144+0000","last_unstale":"2024-09-19T05:40:43.471376+0000","last_undegraded":"2024-09-19T05:40:43.471376+0000","last_fullsized":"2024-09-19T05:40:43.471376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:43.471279+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:43.471279+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.471279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:00.563704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.501001+0000","last_change":"2024-09-19T05:40:40.501032+0000","last_active":"2024-09-19T05:40:40.501001+0000","last_peered":"2024-09-19T05:40:40.501001+0000","last_clean":"2024-09-19T05:40:40.501001+0000","last_became_active":"2024-09-19T05:37:42.786082+0000","last_became_peered":"2024-09-19T05:37:42.786082+0000","last_unstale":"2024-09-19T05:40:40.501001+0000","last_undegraded":"2024-09-19T05:40:40.501001+0000","last_fullsized":"2024-09-19T05:40:40.501001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:40.500922+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:40.500922+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.500922+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:18:28.153721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.484511+0000","last_change":"2024-09-19T05:40:50.484546+0000","last_active":"2024-09-19T05:40:50.484511+0000","last_peered":"2024-09-19T05:40:50.484511+0000","last_clean":"2024-09-19T05:40:50.484511+0000","last_became_active":"2024-09-19T05:37:48.360585+0000","last_became_peered":"2024-09-19T05:37:48.360585+0000","last_unstale":"2024-09-19T05:40:50.484511+0000","last_undegraded":"2024-09-19T05:40:50.484511+0000","last_fullsized":"2024-09-19T05:40:50.484511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.484406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.484406+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.484406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:57.911980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.785714+0000","last_change":"2024-09-19T05:40:47.785739+0000","last_active":"2024-09-19T05:40:47.785714+0000","last_peered":"2024-09-19T05:40:47.785714+0000","last_clean":"2024-09-19T05:40:47.785714+0000","last_became_active":"2024-09-19T05:37:43.799719+0000","last_became_peered":"2024-09-19T05:37:43.799719+0000","last_unstale":"2024-09-19T05:40:47.785714+0000","last_undegraded":"2024-09-19T05:40:47.785714+0000","last_fullsized":"2024-09-19T05:40:47.785714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:47.785616+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:47.785616+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.785616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:53.664695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'11","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.330007+0000","last_change":"2024-09-19T05:40:39.330049+0000","last_active":"2024-09-19T05:40:39.330007+0000","last_peered":"2024-09-19T05:40:39.330007+0000","last_clean":"2024-09-19T05:40:39.330007+0000","last_became_active":"2024-09-19T05:37:42.790450+0000","last_became_peered":"2024-09-19T05:37:42.790450+0000","last_unstale":"2024-09-19T05:40:39.330007+0000","last_undegraded":"2024-09-19T05:40:39.330007+0000","last_fullsized":"2024-09-19T05:40:39.330007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:39.329923+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:39.329923+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.329923+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:46.105565+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.507572+0000","last_change":"2024-09-19T05:40:39.507621+0000","last_active":"2024-09-19T05:40:39.507572+0000","last_peered":"2024-09-19T05:40:39.507572+0000","last_clean":"2024-09-19T05:40:39.507572+0000","last_became_active":"2024-09-19T05:37:33.264459+0000","last_became_peered":"2024-09-19T05:37:33.264459+0000","last_unstale":"2024-09-19T05:40:39.507572+0000","last_undegraded":"2024-09-19T05:40:39.507572+0000","last_fullsized":"2024-09-19T05:40:39.507572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-09-19T05:40:39.507488+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-09-19T05:40:39.507488+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.507488+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:08.513098+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.427070+0000","last_change":"2024-09-19T05:40:47.427094+0000","last_active":"2024-09-19T05:40:47.427070+0000","last_peered":"2024-09-19T05:40:47.427070+0000","last_clean":"2024-09-19T05:40:47.427070+0000","last_became_active":"2024-09-19T05:37:48.360116+0000","last_became_peered":"2024-09-19T05:37:48.360116+0000","last_unstale":"2024-09-19T05:40:47.427070+0000","last_undegraded":"2024-09-19T05:40:47.427070+0000","last_fullsized":"2024-09-19T05:40:47.427070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.426987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.426987+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.426987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:58.307098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:53.392002+0000","last_change":"2024-09-19T05:40:53.392030+0000","last_active":"2024-09-19T05:40:53.392002+0000","last_peered":"2024-09-19T05:40:53.392002+0000","last_clean":"2024-09-19T05:40:53.392002+0000","last_became_active":"2024-09-19T05:37:43.799376+0000","last_became_peered":"2024-09-19T05:37:43.799376+0000","last_unstale":"2024-09-19T05:40:53.392002+0000","last_undegraded":"2024-09-19T05:40:53.392002+0000","last_fullsized":"2024-09-19T05:40:53.392002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:53.391916+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:53.391916+0000","last_clean_scrub_stamp":"2024-09-19T05:40:53.391916+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:50.903310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'9","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.690065+0000","last_change":"2024-09-19T05:40:36.690093+0000","last_active":"2024-09-19T05:40:36.690065+0000","last_peered":"2024-09-19T05:40:36.690065+0000","last_clean":"2024-09-19T05:40:36.690065+0000","last_became_active":"2024-09-19T05:37:42.791157+0000","last_became_peered":"2024-09-19T05:37:42.791157+0000","last_unstale":"2024-09-19T05:40:36.690065+0000","last_undegraded":"2024-09-19T05:40:36.690065+0000","last_fullsized":"2024-09-19T05:40:36.690065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:36.689994+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:36.689994+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.689994+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:07.484014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.444409+0000","last_change":"2024-09-19T05:40:49.444441+0000","last_active":"2024-09-19T05:40:49.444409+0000","last_peered":"2024-09-19T05:40:49.444409+0000","last_clean":"2024-09-19T05:40:49.444409+0000","last_became_active":"2024-09-19T05:38:26.695955+0000","last_became_peered":"2024-09-19T05:38:26.695955+0000","last_unstale":"2024-09-19T05:40:49.444409+0000","last_undegraded":"2024-09-19T05:40:49.444409+0000","last_fullsized":"2024-09-19T05:40:49.444409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.444302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.444302+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.444302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:18.147987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.407542+0000","last_change":"2024-09-19T05:40:36.407599+0000","last_active":"2024-09-19T05:40:36.407542+0000","last_peered":"2024-09-19T05:40:36.407542+0000","last_clean":"2024-09-19T05:40:36.407542+0000","last_became_active":"2024-09-19T05:37:43.798229+0000","last_became_peered":"2024-09-19T05:37:43.798229+0000","last_unstale":"2024-09-19T05:40:36.407542+0000","last_undegraded":"2024-09-19T05:40:36.407542+0000","last_fullsized":"2024-09-19T05:40:36.407542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:36.407434+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:36.407434+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.407434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:30.430330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.288437+0000","last_change":"2024-09-19T05:40:37.288476+0000","last_active":"2024-09-19T05:40:37.288437+0000","last_peered":"2024-09-19T05:40:37.288437+0000","last_clean":"2024-09-19T05:40:37.288437+0000","last_became_active":"2024-09-19T05:37:42.789130+0000","last_became_peered":"2024-09-19T05:37:42.789130+0000","last_unstale":"2024-09-19T05:40:37.288437+0000","last_undegraded":"2024-09-19T05:40:37.288437+0000","last_fullsized":"2024-09-19T05:40:37.288437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:37.288360+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:37.288360+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.288360+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:55.255400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.506451+0000","last_change":"2024-09-19T05:40:46.506483+0000","last_active":"2024-09-19T05:40:46.506451+0000","last_peered":"2024-09-19T05:40:46.506451+0000","last_clean":"2024-09-19T05:40:46.506451+0000","last_became_active":"2024-09-19T05:37:47.818189+0000","last_became_peered":"2024-09-19T05:37:47.818189+0000","last_unstale":"2024-09-19T05:40:46.506451+0000","last_undegraded":"2024-09-19T05:40:46.506451+0000","last_fullsized":"2024-09-19T05:40:46.506451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:46.506363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:46.506363+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.506363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:36.842989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:51.431402+0000","last_change":"2024-09-19T05:40:51.431444+0000","last_active":"2024-09-19T05:40:51.431402+0000","last_peered":"2024-09-19T05:40:51.431402+0000","last_clean":"2024-09-19T05:40:51.431402+0000","last_became_active":"2024-09-19T05:37:43.797645+0000","last_became_peered":"2024-09-19T05:37:43.797645+0000","last_unstale":"2024-09-19T05:40:51.431402+0000","last_undegraded":"2024-09-19T05:40:51.431402+0000","last_fullsized":"2024-09-19T05:40:51.431402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:51.431306+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:51.431306+0000","last_clean_scrub_stamp":"2024-09-19T05:40:51.431306+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:36.487974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'7","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.694580+0000","last_change":"2024-09-19T05:40:38.694618+0000","last_active":"2024-09-19T05:40:38.694580+0000","last_peered":"2024-09-19T05:40:38.694580+0000","last_clean":"2024-09-19T05:40:38.694580+0000","last_became_active":"2024-09-19T05:37:42.792711+0000","last_became_peered":"2024-09-19T05:37:42.792711+0000","last_unstale":"2024-09-19T05:40:38.694580+0000","last_undegraded":"2024-09-19T05:40:38.694580+0000","last_fullsized":"2024-09-19T05:40:38.694580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:38.694476+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:38.694476+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.694476+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:45.226431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:53.312972+0000","last_change":"2024-09-19T05:40:53.312998+0000","last_active":"2024-09-19T05:40:53.312972+0000","last_peered":"2024-09-19T05:40:53.312972+0000","last_clean":"2024-09-19T05:40:53.312972+0000","last_became_active":"2024-09-19T05:37:48.362167+0000","last_became_peered":"2024-09-19T05:37:48.362167+0000","last_unstale":"2024-09-19T05:40:53.312972+0000","last_undegraded":"2024-09-19T05:40:53.312972+0000","last_fullsized":"2024-09-19T05:40:53.312972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:53.312871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:53.312871+0000","last_clean_scrub_stamp":"2024-09-19T05:40:53.312871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:07.677011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:54.346986+0000","last_change":"2024-09-19T05:40:54.347035+0000","last_active":"2024-09-19T05:40:54.346986+0000","last_peered":"2024-09-19T05:40:54.346986+0000","last_clean":"2024-09-19T05:40:54.346986+0000","last_became_active":"2024-09-19T05:37:43.801708+0000","last_became_peered":"2024-09-19T05:37:43.801708+0000","last_unstale":"2024-09-19T05:40:54.346986+0000","last_undegraded":"2024-09-19T05:40:54.346986+0000","last_fullsized":"2024-09-19T05:40:54.346986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:54.346885+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:54.346885+0000","last_clean_scrub_stamp":"2024-09-19T05:40:54.346885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:55.470733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.567822+0000","last_change":"2024-09-19T05:40:35.567859+0000","last_active":"2024-09-19T05:40:35.567822+0000","last_peered":"2024-09-19T05:40:35.567822+0000","last_clean":"2024-09-19T05:40:35.567822+0000","last_became_active":"2024-09-19T05:37:42.787067+0000","last_became_peered":"2024-09-19T05:37:42.787067+0000","last_unstale":"2024-09-19T05:40:35.567822+0000","last_undegraded":"2024-09-19T05:40:35.567822+0000","last_fullsized":"2024-09-19T05:40:35.567822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:35.567731+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:35.567731+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.567731+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:44.712577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.657522+0000","last_change":"2024-09-19T05:40:46.657548+0000","last_active":"2024-09-19T05:40:46.657522+0000","last_peered":"2024-09-19T05:40:46.657522+0000","last_clean":"2024-09-19T05:40:46.657522+0000","last_became_active":"2024-09-19T05:37:47.815122+0000","last_became_peered":"2024-09-19T05:37:47.815122+0000","last_unstale":"2024-09-19T05:40:46.657522+0000","last_undegraded":"2024-09-19T05:40:46.657522+0000","last_fullsized":"2024-09-19T05:40:46.657522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:46.657412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:46.657412+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.657412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:46.002977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.458809+0000","last_change":"2024-09-19T05:40:48.458839+0000","last_active":"2024-09-19T05:40:48.458809+0000","last_peered":"2024-09-19T05:40:48.458809+0000","last_clean":"2024-09-19T05:40:48.458809+0000","last_became_active":"2024-09-19T05:37:43.794677+0000","last_became_peered":"2024-09-19T05:37:43.794677+0000","last_unstale":"2024-09-19T05:40:48.458809+0000","last_undegraded":"2024-09-19T05:40:48.458809+0000","last_fullsized":"2024-09-19T05:40:48.458809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:48.458714+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:48.458714+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.458714+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:19.006219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'26","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.654026+0000","last_change":"2024-09-19T05:40:35.654064+0000","last_active":"2024-09-19T05:40:35.654026+0000","last_peered":"2024-09-19T05:40:35.654026+0000","last_clean":"2024-09-19T05:40:35.654026+0000","last_became_active":"2024-09-19T05:37:42.780764+0000","last_became_peered":"2024-09-19T05:37:42.780764+0000","last_unstale":"2024-09-19T05:40:35.654026+0000","last_undegraded":"2024-09-19T05:40:35.654026+0000","last_fullsized":"2024-09-19T05:40:35.654026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2024-09-19T05:40:35.653955+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2024-09-19T05:40:35.653955+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.653955+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:51.016229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.502379+0000","last_change":"2024-09-19T05:40:47.502406+0000","last_active":"2024-09-19T05:40:47.502379+0000","last_peered":"2024-09-19T05:40:47.502379+0000","last_clean":"2024-09-19T05:40:47.502379+0000","last_became_active":"2024-09-19T05:37:47.819767+0000","last_became_peered":"2024-09-19T05:37:47.819767+0000","last_unstale":"2024-09-19T05:40:47.502379+0000","last_undegraded":"2024-09-19T05:40:47.502379+0000","last_fullsized":"2024-09-19T05:40:47.502379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:47.502292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:47.502292+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.502292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:15.218420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.480247+0000","last_change":"2024-09-19T05:40:43.480274+0000","last_active":"2024-09-19T05:40:43.480247+0000","last_peered":"2024-09-19T05:40:43.480247+0000","last_clean":"2024-09-19T05:40:43.480247+0000","last_became_active":"2024-09-19T05:37:43.793084+0000","last_became_peered":"2024-09-19T05:37:43.793084+0000","last_unstale":"2024-09-19T05:40:43.480247+0000","last_undegraded":"2024-09-19T05:40:43.480247+0000","last_fullsized":"2024-09-19T05:40:43.480247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:43.480160+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:43.480160+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.480160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:23.473541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.451395+0000","last_change":"2024-09-19T05:40:37.451427+0000","last_active":"2024-09-19T05:40:37.451395+0000","last_peered":"2024-09-19T05:40:37.451395+0000","last_clean":"2024-09-19T05:40:37.451395+0000","last_became_active":"2024-09-19T05:37:42.785822+0000","last_became_peered":"2024-09-19T05:37:42.785822+0000","last_unstale":"2024-09-19T05:40:37.451395+0000","last_undegraded":"2024-09-19T05:40:37.451395+0000","last_fullsized":"2024-09-19T05:40:37.451395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:37.451288+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:37.451288+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.451288+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:42.362036+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.869233+0000","last_change":"2024-09-19T05:40:50.869285+0000","last_active":"2024-09-19T05:40:50.869233+0000","last_peered":"2024-09-19T05:40:50.869233+0000","last_clean":"2024-09-19T05:40:50.869233+0000","last_became_active":"2024-09-19T05:37:48.359915+0000","last_became_peered":"2024-09-19T05:37:48.359915+0000","last_unstale":"2024-09-19T05:40:50.869233+0000","last_undegraded":"2024-09-19T05:40:50.869233+0000","last_fullsized":"2024-09-19T05:40:50.869233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.869132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.869132+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.869132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:23.412793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'15","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.450934+0000","last_change":"2024-09-19T05:40:47.450959+0000","last_active":"2024-09-19T05:40:47.450934+0000","last_peered":"2024-09-19T05:40:47.450934+0000","last_clean":"2024-09-19T05:40:47.450934+0000","last_became_active":"2024-09-19T05:37:43.793996+0000","last_became_peered":"2024-09-19T05:37:43.793996+0000","last_unstale":"2024-09-19T05:40:47.450934+0000","last_undegraded":"2024-09-19T05:40:47.450934+0000","last_fullsized":"2024-09-19T05:40:47.450934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:47.450848+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:47.450848+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.450848+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:51.354956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.279250+0000","last_change":"2024-09-19T05:40:42.279280+0000","last_active":"2024-09-19T05:40:42.279250+0000","last_peered":"2024-09-19T05:40:42.279250+0000","last_clean":"2024-09-19T05:40:42.279250+0000","last_became_active":"2024-09-19T05:37:42.793578+0000","last_became_peered":"2024-09-19T05:37:42.793578+0000","last_unstale":"2024-09-19T05:40:42.279250+0000","last_undegraded":"2024-09-19T05:40:42.279250+0000","last_fullsized":"2024-09-19T05:40:42.279250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:42.279169+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:42.279169+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.279169+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:09.432691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:51.827948+0000","last_change":"2024-09-19T05:40:51.827977+0000","last_active":"2024-09-19T05:40:51.827948+0000","last_peered":"2024-09-19T05:40:51.827948+0000","last_clean":"2024-09-19T05:40:51.827948+0000","last_became_active":"2024-09-19T05:37:48.360628+0000","last_became_peered":"2024-09-19T05:37:48.360628+0000","last_unstale":"2024-09-19T05:40:51.827948+0000","last_undegraded":"2024-09-19T05:40:51.827948+0000","last_fullsized":"2024-09-19T05:40:51.827948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:51.827834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:51.827834+0000","last_clean_scrub_stamp":"2024-09-19T05:40:51.827834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:48.535168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.512999+0000","last_change":"2024-09-19T05:40:37.513033+0000","last_active":"2024-09-19T05:40:37.512999+0000","last_peered":"2024-09-19T05:40:37.512999+0000","last_clean":"2024-09-19T05:40:37.512999+0000","last_became_active":"2024-09-19T05:37:43.788359+0000","last_became_peered":"2024-09-19T05:37:43.788359+0000","last_unstale":"2024-09-19T05:40:37.512999+0000","last_undegraded":"2024-09-19T05:40:37.512999+0000","last_fullsized":"2024-09-19T05:40:37.512999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:37.512925+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:37.512925+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.512925+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:23.535615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'15","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.483136+0000","last_change":"2024-09-19T05:40:36.483169+0000","last_active":"2024-09-19T05:40:36.483136+0000","last_peered":"2024-09-19T05:40:36.483136+0000","last_clean":"2024-09-19T05:40:36.483136+0000","last_became_active":"2024-09-19T05:37:42.786918+0000","last_became_peered":"2024-09-19T05:37:42.786918+0000","last_unstale":"2024-09-19T05:40:36.483136+0000","last_undegraded":"2024-09-19T05:40:36.483136+0000","last_fullsized":"2024-09-19T05:40:36.483136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:36.483071+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:36.483071+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.483071+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:54.776731+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:52.286883+0000","last_change":"2024-09-19T05:40:52.286915+0000","last_active":"2024-09-19T05:40:52.286883+0000","last_peered":"2024-09-19T05:40:52.286883+0000","last_clean":"2024-09-19T05:40:52.286883+0000","last_became_active":"2024-09-19T05:37:48.359815+0000","last_became_peered":"2024-09-19T05:37:48.359815+0000","last_unstale":"2024-09-19T05:40:52.286883+0000","last_undegraded":"2024-09-19T05:40:52.286883+0000","last_fullsized":"2024-09-19T05:40:52.286883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:52.286784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:52.286784+0000","last_clean_scrub_stamp":"2024-09-19T05:40:52.286784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:00.410305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.468128+0000","last_change":"2024-09-19T05:40:46.468169+0000","last_active":"2024-09-19T05:40:46.468128+0000","last_peered":"2024-09-19T05:40:46.468128+0000","last_clean":"2024-09-19T05:40:46.468128+0000","last_became_active":"2024-09-19T05:37:43.791595+0000","last_became_peered":"2024-09-19T05:37:43.791595+0000","last_unstale":"2024-09-19T05:40:46.468128+0000","last_undegraded":"2024-09-19T05:40:46.468128+0000","last_fullsized":"2024-09-19T05:40:46.468128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:46.468025+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:46.468025+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.468025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:26.420568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'37","reported_seq":75,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.493070+0000","last_change":"2024-09-19T05:40:40.493109+0000","last_active":"2024-09-19T05:40:40.493070+0000","last_peered":"2024-09-19T05:40:40.493070+0000","last_clean":"2024-09-19T05:40:40.493070+0000","last_became_active":"2024-09-19T05:37:42.792177+0000","last_became_peered":"2024-09-19T05:37:42.792177+0000","last_unstale":"2024-09-19T05:40:40.493070+0000","last_undegraded":"2024-09-19T05:40:40.493070+0000","last_fullsized":"2024-09-19T05:40:40.493070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2024-09-19T05:40:40.492979+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2024-09-19T05:40:40.492979+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.492979+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:57.763050+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.361915+0000","last_change":"2024-09-19T05:40:46.361973+0000","last_active":"2024-09-19T05:40:46.361915+0000","last_peered":"2024-09-19T05:40:46.361915+0000","last_clean":"2024-09-19T05:40:46.361915+0000","last_became_active":"2024-09-19T05:37:47.819983+0000","last_became_peered":"2024-09-19T05:37:47.819983+0000","last_unstale":"2024-09-19T05:40:46.361915+0000","last_undegraded":"2024-09-19T05:40:46.361915+0000","last_fullsized":"2024-09-19T05:40:46.361915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-19T05:40:46.361812+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-19T05:40:46.361812+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.361812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:05.391467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.530516+0000","last_change":"2024-09-19T05:40:36.530555+0000","last_active":"2024-09-19T05:40:36.530516+0000","last_peered":"2024-09-19T05:40:36.530516+0000","last_clean":"2024-09-19T05:40:36.530516+0000","last_became_active":"2024-09-19T05:37:43.786280+0000","last_became_peered":"2024-09-19T05:37:43.786280+0000","last_unstale":"2024-09-19T05:40:36.530516+0000","last_undegraded":"2024-09-19T05:40:36.530516+0000","last_fullsized":"2024-09-19T05:40:36.530516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:36.530434+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:36.530434+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.530434+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:37.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'12","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.294221+0000","last_change":"2024-09-19T05:40:40.294273+0000","last_active":"2024-09-19T05:40:40.294221+0000","last_peered":"2024-09-19T05:40:40.294221+0000","last_clean":"2024-09-19T05:40:40.294221+0000","last_became_active":"2024-09-19T05:37:42.790950+0000","last_became_peered":"2024-09-19T05:37:42.790950+0000","last_unstale":"2024-09-19T05:40:40.294221+0000","last_undegraded":"2024-09-19T05:40:40.294221+0000","last_fullsized":"2024-09-19T05:40:40.294221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-19T05:40:40.294109+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-19T05:40:40.294109+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.294109+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.089697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.583828+0000","last_change":"2024-09-19T05:40:42.583870+0000","last_active":"2024-09-19T05:40:42.583828+0000","last_peered":"2024-09-19T05:40:42.583828+0000","last_clean":"2024-09-19T05:40:42.583828+0000","last_became_active":"2024-09-19T05:37:47.813382+0000","last_became_peered":"2024-09-19T05:37:47.813382+0000","last_unstale":"2024-09-19T05:40:42.583828+0000","last_undegraded":"2024-09-19T05:40:42.583828+0000","last_fullsized":"2024-09-19T05:40:42.583828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:42.583712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:42.583712+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.583712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:03.181590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.483911+0000","last_change":"2024-09-19T05:40:44.483951+0000","last_active":"2024-09-19T05:40:44.483911+0000","last_peered":"2024-09-19T05:40:44.483911+0000","last_clean":"2024-09-19T05:40:44.483911+0000","last_became_active":"2024-09-19T05:37:43.800528+0000","last_became_peered":"2024-09-19T05:37:43.800528+0000","last_unstale":"2024-09-19T05:40:44.483911+0000","last_undegraded":"2024-09-19T05:40:44.483911+0000","last_fullsized":"2024-09-19T05:40:44.483911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:44.483801+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:44.483801+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.483801+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:56.363906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.333820+0000","last_change":"2024-09-19T05:40:40.333851+0000","last_active":"2024-09-19T05:40:40.333820+0000","last_peered":"2024-09-19T05:40:40.333820+0000","last_clean":"2024-09-19T05:40:40.333820+0000","last_became_active":"2024-09-19T05:37:42.792938+0000","last_became_peered":"2024-09-19T05:37:42.792938+0000","last_unstale":"2024-09-19T05:40:40.333820+0000","last_undegraded":"2024-09-19T05:40:40.333820+0000","last_fullsized":"2024-09-19T05:40:40.333820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:40.333719+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:40.333719+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.333719+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:58.788782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.816990+0000","last_change":"2024-09-19T05:40:48.817016+0000","last_active":"2024-09-19T05:40:48.816990+0000","last_peered":"2024-09-19T05:40:48.816990+0000","last_clean":"2024-09-19T05:40:48.816990+0000","last_became_active":"2024-09-19T05:37:47.816662+0000","last_became_peered":"2024-09-19T05:37:47.816662+0000","last_unstale":"2024-09-19T05:40:48.816990+0000","last_undegraded":"2024-09-19T05:40:48.816990+0000","last_fullsized":"2024-09-19T05:40:48.816990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:48.816881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:48.816881+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.816881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:40.593112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'10","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.668488+0000","last_change":"2024-09-19T05:40:43.668488+0000","last_active":"2024-09-19T05:40:43.668488+0000","last_peered":"2024-09-19T05:40:43.668488+0000","last_clean":"2024-09-19T05:40:43.668488+0000","last_became_active":"2024-09-19T05:38:26.669548+0000","last_became_peered":"2024-09-19T05:38:26.669548+0000","last_unstale":"2024-09-19T05:40:43.668488+0000","last_undegraded":"2024-09-19T05:40:43.668488+0000","last_fullsized":"2024-09-19T05:40:43.668488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:43.668321+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:43.668321+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.668321+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.950937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.445084+0000","last_change":"2024-09-19T05:40:39.445118+0000","last_active":"2024-09-19T05:40:39.445084+0000","last_peered":"2024-09-19T05:40:39.445084+0000","last_clean":"2024-09-19T05:40:39.445084+0000","last_became_active":"2024-09-19T05:37:42.790888+0000","last_became_peered":"2024-09-19T05:37:42.790888+0000","last_unstale":"2024-09-19T05:40:39.445084+0000","last_undegraded":"2024-09-19T05:40:39.445084+0000","last_fullsized":"2024-09-19T05:40:39.445084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:39.444995+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:39.444995+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.444995+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:43.454680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:52.806997+0000","last_change":"2024-09-19T05:40:52.807046+0000","last_active":"2024-09-19T05:40:52.806997+0000","last_peered":"2024-09-19T05:40:52.806997+0000","last_clean":"2024-09-19T05:40:52.806997+0000","last_became_active":"2024-09-19T05:37:48.361045+0000","last_became_peered":"2024-09-19T05:37:48.361045+0000","last_unstale":"2024-09-19T05:40:52.806997+0000","last_undegraded":"2024-09-19T05:40:52.806997+0000","last_fullsized":"2024-09-19T05:40:52.806997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:52.806863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:52.806863+0000","last_clean_scrub_stamp":"2024-09-19T05:40:52.806863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:57.050486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.520970+0000","last_change":"2024-09-19T05:40:49.520996+0000","last_active":"2024-09-19T05:40:49.520970+0000","last_peered":"2024-09-19T05:40:49.520970+0000","last_clean":"2024-09-19T05:40:49.520970+0000","last_became_active":"2024-09-19T05:37:48.360048+0000","last_became_peered":"2024-09-19T05:37:48.360048+0000","last_unstale":"2024-09-19T05:40:49.520970+0000","last_undegraded":"2024-09-19T05:40:49.520970+0000","last_fullsized":"2024-09-19T05:40:49.520970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.520883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.520883+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.520883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:44.734662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.309128+0000","last_change":"2024-09-19T05:40:43.309178+0000","last_active":"2024-09-19T05:40:43.309128+0000","last_peered":"2024-09-19T05:40:43.309128+0000","last_clean":"2024-09-19T05:40:43.309128+0000","last_became_active":"2024-09-19T05:37:43.789636+0000","last_became_peered":"2024-09-19T05:37:43.789636+0000","last_unstale":"2024-09-19T05:40:43.309128+0000","last_undegraded":"2024-09-19T05:40:43.309128+0000","last_fullsized":"2024-09-19T05:40:43.309128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:43.309019+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:43.309019+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.309019+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:07.438318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.295945+0000","last_change":"2024-09-19T05:40:41.295979+0000","last_active":"2024-09-19T05:40:41.295945+0000","last_peered":"2024-09-19T05:40:41.295945+0000","last_clean":"2024-09-19T05:40:41.295945+0000","last_became_active":"2024-09-19T05:37:42.793411+0000","last_became_peered":"2024-09-19T05:37:42.793411+0000","last_unstale":"2024-09-19T05:40:41.295945+0000","last_undegraded":"2024-09-19T05:40:41.295945+0000","last_fullsized":"2024-09-19T05:40:41.295945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:41.295859+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:41.295859+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.295859+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:42.833900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.477804+0000","last_change":"2024-09-19T05:40:50.477847+0000","last_active":"2024-09-19T05:40:50.477804+0000","last_peered":"2024-09-19T05:40:50.477804+0000","last_clean":"2024-09-19T05:40:50.477804+0000","last_became_active":"2024-09-19T05:38:26.695907+0000","last_became_peered":"2024-09-19T05:38:26.695907+0000","last_unstale":"2024-09-19T05:40:50.477804+0000","last_undegraded":"2024-09-19T05:40:50.477804+0000","last_fullsized":"2024-09-19T05:40:50.477804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:50.477672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:50.477672+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.477672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:44.488643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:36.842792+0000","last_change":"2024-09-19T05:40:36.842813+0000","last_active":"2024-09-19T05:40:36.842792+0000","last_peered":"2024-09-19T05:40:36.842792+0000","last_clean":"2024-09-19T05:40:36.842792+0000","last_became_active":"2024-09-19T05:37:43.792843+0000","last_became_peered":"2024-09-19T05:37:43.792843+0000","last_unstale":"2024-09-19T05:40:36.842792+0000","last_undegraded":"2024-09-19T05:40:36.842792+0000","last_fullsized":"2024-09-19T05:40:36.842792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:36.842725+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:36.842725+0000","last_clean_scrub_stamp":"2024-09-19T05:40:36.842725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:31.777186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.827951+0000","last_change":"2024-09-19T05:40:40.827984+0000","last_active":"2024-09-19T05:40:40.827951+0000","last_peered":"2024-09-19T05:40:40.827951+0000","last_clean":"2024-09-19T05:40:40.827951+0000","last_became_active":"2024-09-19T05:37:42.792074+0000","last_became_peered":"2024-09-19T05:37:42.792074+0000","last_unstale":"2024-09-19T05:40:40.827951+0000","last_undegraded":"2024-09-19T05:40:40.827951+0000","last_fullsized":"2024-09-19T05:40:40.827951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:40.827867+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:40.827867+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.827867+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:57.855764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'10","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.483925+0000","last_change":"2024-09-19T05:40:38.483955+0000","last_active":"2024-09-19T05:40:38.483925+0000","last_peered":"2024-09-19T05:40:38.483925+0000","last_clean":"2024-09-19T05:40:38.483925+0000","last_became_active":"2024-09-19T05:37:42.785849+0000","last_became_peered":"2024-09-19T05:37:42.785849+0000","last_unstale":"2024-09-19T05:40:38.483925+0000","last_undegraded":"2024-09-19T05:40:38.483925+0000","last_fullsized":"2024-09-19T05:40:38.483925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:38.483842+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:38.483842+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.483842+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:03.253962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.488353+0000","last_change":"2024-09-19T05:40:42.488396+0000","last_active":"2024-09-19T05:40:42.488353+0000","last_peered":"2024-09-19T05:40:42.488353+0000","last_clean":"2024-09-19T05:40:42.488353+0000","last_became_active":"2024-09-19T05:37:43.794947+0000","last_became_peered":"2024-09-19T05:37:43.794947+0000","last_unstale":"2024-09-19T05:40:42.488353+0000","last_undegraded":"2024-09-19T05:40:42.488353+0000","last_fullsized":"2024-09-19T05:40:42.488353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:42.488247+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:42.488247+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.488247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.052872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.637362+0000","last_change":"2024-09-19T05:40:40.637386+0000","last_active":"2024-09-19T05:40:40.637362+0000","last_peered":"2024-09-19T05:40:40.637362+0000","last_clean":"2024-09-19T05:40:40.637362+0000","last_became_active":"2024-09-19T05:37:47.812635+0000","last_became_peered":"2024-09-19T05:37:47.812635+0000","last_unstale":"2024-09-19T05:40:40.637362+0000","last_undegraded":"2024-09-19T05:40:40.637362+0000","last_fullsized":"2024-09-19T05:40:40.637362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:40.637271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:40.637271+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.637271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:53.417043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.860243+0000","last_change":"2024-09-19T05:40:39.860280+0000","last_active":"2024-09-19T05:40:39.860243+0000","last_peered":"2024-09-19T05:40:39.860243+0000","last_clean":"2024-09-19T05:40:39.860243+0000","last_became_active":"2024-09-19T05:37:42.788780+0000","last_became_peered":"2024-09-19T05:37:42.788780+0000","last_unstale":"2024-09-19T05:40:39.860243+0000","last_undegraded":"2024-09-19T05:40:39.860243+0000","last_fullsized":"2024-09-19T05:40:39.860243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:39.860156+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:39.860156+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.860156+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:51.799282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1206,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.542460+0000","last_change":"2024-09-19T05:40:37.542486+0000","last_active":"2024-09-19T05:40:37.542460+0000","last_peered":"2024-09-19T05:40:37.542460+0000","last_clean":"2024-09-19T05:40:37.542460+0000","last_became_active":"2024-09-19T05:37:43.786734+0000","last_became_peered":"2024-09-19T05:37:43.786734+0000","last_unstale":"2024-09-19T05:40:37.542460+0000","last_undegraded":"2024-09-19T05:40:37.542460+0000","last_fullsized":"2024-09-19T05:40:37.542460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:37.542380+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:37.542380+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.542380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:14.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.827262+0000","last_change":"2024-09-19T05:40:49.827309+0000","last_active":"2024-09-19T05:40:49.827262+0000","last_peered":"2024-09-19T05:40:49.827262+0000","last_clean":"2024-09-19T05:40:49.827262+0000","last_became_active":"2024-09-19T05:37:47.818521+0000","last_became_peered":"2024-09-19T05:37:47.818521+0000","last_unstale":"2024-09-19T05:40:49.827262+0000","last_undegraded":"2024-09-19T05:40:49.827262+0000","last_fullsized":"2024-09-19T05:40:49.827262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:40:49.827141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:40:49.827141+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.827141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:58.457521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.465036+0000","last_change":"2024-09-19T05:40:44.465067+0000","last_active":"2024-09-19T05:40:44.465036+0000","last_peered":"2024-09-19T05:40:44.465036+0000","last_clean":"2024-09-19T05:40:44.465036+0000","last_became_active":"2024-09-19T05:37:43.793382+0000","last_became_peered":"2024-09-19T05:37:43.793382+0000","last_unstale":"2024-09-19T05:40:44.465036+0000","last_undegraded":"2024-09-19T05:40:44.465036+0000","last_fullsized":"2024-09-19T05:40:44.465036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:44.464938+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:44.464938+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.464938+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:21.676807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.706855+0000","last_change":"2024-09-19T05:40:42.706899+0000","last_active":"2024-09-19T05:40:42.706855+0000","last_peered":"2024-09-19T05:40:42.706855+0000","last_clean":"2024-09-19T05:40:42.706855+0000","last_became_active":"2024-09-19T05:38:25.967590+0000","last_became_peered":"2024-09-19T05:38:25.967590+0000","last_unstale":"2024-09-19T05:40:42.706855+0000","last_undegraded":"2024-09-19T05:40:42.706855+0000","last_fullsized":"2024-09-19T05:40:42.706855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-19T05:40:42.706752+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-19T05:40:42.706752+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.706752+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:57.945004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.378933+0000","last_change":"2024-09-19T05:40:37.378977+0000","last_active":"2024-09-19T05:40:37.378933+0000","last_peered":"2024-09-19T05:40:37.378933+0000","last_clean":"2024-09-19T05:40:37.378933+0000","last_became_active":"2024-09-19T05:37:43.797554+0000","last_became_peered":"2024-09-19T05:37:43.797554+0000","last_unstale":"2024-09-19T05:40:37.378933+0000","last_undegraded":"2024-09-19T05:40:37.378933+0000","last_fullsized":"2024-09-19T05:40:37.378933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:37.378833+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:37.378833+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.378833+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:07.583591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:34.447005+0000","last_change":"2024-09-19T05:40:34.447027+0000","last_active":"2024-09-19T05:40:34.447005+0000","last_peered":"2024-09-19T05:40:34.447005+0000","last_clean":"2024-09-19T05:40:34.447005+0000","last_became_active":"2024-09-19T05:37:43.795392+0000","last_became_peered":"2024-09-19T05:37:43.795392+0000","last_unstale":"2024-09-19T05:40:34.447005+0000","last_undegraded":"2024-09-19T05:40:34.447005+0000","last_fullsized":"2024-09-19T05:40:34.447005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:34.446941+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:34.446941+0000","last_clean_scrub_stamp":"2024-09-19T05:40:34.446941+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:52.636285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'4","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.660306+0000","last_change":"2024-09-19T05:40:41.660335+0000","last_active":"2024-09-19T05:40:41.660306+0000","last_peered":"2024-09-19T05:40:41.660306+0000","last_clean":"2024-09-19T05:40:41.660306+0000","last_became_active":"2024-09-19T05:38:25.967411+0000","last_became_peered":"2024-09-19T05:38:25.967411+0000","last_unstale":"2024-09-19T05:40:41.660306+0000","last_undegraded":"2024-09-19T05:40:41.660306+0000","last_fullsized":"2024-09-19T05:40:41.660306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:41.660219+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:41.660219+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.660219+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:25.520396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:41.296496+0000","last_change":"2024-09-19T05:40:41.296532+0000","last_active":"2024-09-19T05:40:41.296496+0000","last_peered":"2024-09-19T05:40:41.296496+0000","last_clean":"2024-09-19T05:40:41.296496+0000","last_became_active":"2024-09-19T05:37:43.785282+0000","last_became_peered":"2024-09-19T05:37:43.785282+0000","last_unstale":"2024-09-19T05:40:41.296496+0000","last_undegraded":"2024-09-19T05:40:41.296496+0000","last_fullsized":"2024-09-19T05:40:41.296496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:41.296406+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:41.296406+0000","last_clean_scrub_stamp":"2024-09-19T05:40:41.296406+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:58:10.042153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'15","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.465814+0000","last_change":"2024-09-19T05:40:45.465840+0000","last_active":"2024-09-19T05:40:45.465814+0000","last_peered":"2024-09-19T05:40:45.465814+0000","last_clean":"2024-09-19T05:40:45.465814+0000","last_became_active":"2024-09-19T05:37:43.796494+0000","last_became_peered":"2024-09-19T05:37:43.796494+0000","last_unstale":"2024-09-19T05:40:45.465814+0000","last_undegraded":"2024-09-19T05:40:45.465814+0000","last_fullsized":"2024-09-19T05:40:45.465814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-19T05:40:45.465727+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-19T05:40:45.465727+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.465727+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:52.868140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.823903+0000","last_change":"2024-09-19T05:40:37.823927+0000","last_active":"2024-09-19T05:40:37.823903+0000","last_peered":"2024-09-19T05:40:37.823903+0000","last_clean":"2024-09-19T05:40:37.823903+0000","last_became_active":"2024-09-19T05:37:43.794469+0000","last_became_peered":"2024-09-19T05:37:43.794469+0000","last_unstale":"2024-09-19T05:40:37.823903+0000","last_undegraded":"2024-09-19T05:40:37.823903+0000","last_fullsized":"2024-09-19T05:40:37.823903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-19T05:40:37.823835+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-19T05:40:37.823835+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.823835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:28.474776+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:43.233056+0000","last_change":"2024-09-19T05:40:43.233084+0000","last_active":"2024-09-19T05:40:43.233056+0000","last_peered":"2024-09-19T05:40:43.233056+0000","last_clean":"2024-09-19T05:40:43.233056+0000","last_became_active":"2024-09-19T05:37:43.791417+0000","last_became_peered":"2024-09-19T05:37:43.791417+0000","last_unstale":"2024-09-19T05:40:43.233056+0000","last_undegraded":"2024-09-19T05:40:43.233056+0000","last_fullsized":"2024-09-19T05:40:43.233056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:43.232970+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:43.232970+0000","last_clean_scrub_stamp":"2024-09-19T05:40:43.232970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:51:11.938943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.850443+0000","last_change":"2024-09-19T05:40:38.850497+0000","last_active":"2024-09-19T05:40:38.850443+0000","last_peered":"2024-09-19T05:40:38.850443+0000","last_clean":"2024-09-19T05:40:38.850443+0000","last_became_active":"2024-09-19T05:37:43.793307+0000","last_became_peered":"2024-09-19T05:37:43.793307+0000","last_unstale":"2024-09-19T05:40:38.850443+0000","last_undegraded":"2024-09-19T05:40:38.850443+0000","last_fullsized":"2024-09-19T05:40:38.850443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:38.850347+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:38.850347+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.850347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:25.632460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:47.340105+0000","last_change":"2024-09-19T05:40:47.340133+0000","last_active":"2024-09-19T05:40:47.340105+0000","last_peered":"2024-09-19T05:40:47.340105+0000","last_clean":"2024-09-19T05:40:47.340105+0000","last_became_active":"2024-09-19T05:37:43.798613+0000","last_became_peered":"2024-09-19T05:37:43.798613+0000","last_unstale":"2024-09-19T05:40:47.340105+0000","last_undegraded":"2024-09-19T05:40:47.340105+0000","last_fullsized":"2024-09-19T05:40:47.340105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:47.339994+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:47.339994+0000","last_clean_scrub_stamp":"2024-09-19T05:40:47.339994+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:58.719832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.539483+0000","last_change":"2024-09-19T05:40:38.539543+0000","last_active":"2024-09-19T05:40:38.539483+0000","last_peered":"2024-09-19T05:40:38.539483+0000","last_clean":"2024-09-19T05:40:38.539483+0000","last_became_active":"2024-09-19T05:37:43.788478+0000","last_became_peered":"2024-09-19T05:37:43.788478+0000","last_unstale":"2024-09-19T05:40:38.539483+0000","last_undegraded":"2024-09-19T05:40:38.539483+0000","last_fullsized":"2024-09-19T05:40:38.539483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:38.539360+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:38.539360+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.539360+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:47:22.660026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:42.495348+0000","last_change":"2024-09-19T05:40:42.495373+0000","last_active":"2024-09-19T05:40:42.495348+0000","last_peered":"2024-09-19T05:40:42.495348+0000","last_clean":"2024-09-19T05:40:42.495348+0000","last_became_active":"2024-09-19T05:37:43.788608+0000","last_became_peered":"2024-09-19T05:37:43.788608+0000","last_unstale":"2024-09-19T05:40:42.495348+0000","last_undegraded":"2024-09-19T05:40:42.495348+0000","last_fullsized":"2024-09-19T05:40:42.495348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:42.495262+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:42.495262+0000","last_clean_scrub_stamp":"2024-09-19T05:40:42.495262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:19.532105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:49.432270+0000","last_change":"2024-09-19T05:40:49.432296+0000","last_active":"2024-09-19T05:40:49.432270+0000","last_peered":"2024-09-19T05:40:49.432270+0000","last_clean":"2024-09-19T05:40:49.432270+0000","last_became_active":"2024-09-19T05:37:43.794544+0000","last_became_peered":"2024-09-19T05:37:43.794544+0000","last_unstale":"2024-09-19T05:40:49.432270+0000","last_undegraded":"2024-09-19T05:40:49.432270+0000","last_fullsized":"2024-09-19T05:40:49.432270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:49.432189+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:49.432189+0000","last_clean_scrub_stamp":"2024-09-19T05:40:49.432189+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:19.107028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'10","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.664608+0000","last_change":"2024-09-19T05:40:39.664636+0000","last_active":"2024-09-19T05:40:39.664608+0000","last_peered":"2024-09-19T05:40:39.664608+0000","last_clean":"2024-09-19T05:40:39.664608+0000","last_became_active":"2024-09-19T05:37:43.791257+0000","last_became_peered":"2024-09-19T05:37:43.791257+0000","last_unstale":"2024-09-19T05:40:39.664608+0000","last_undegraded":"2024-09-19T05:40:39.664608+0000","last_fullsized":"2024-09-19T05:40:39.664608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:39.664527+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:39.664527+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.664527+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:13.084376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.305875+0000","last_change":"2024-09-19T05:40:46.305902+0000","last_active":"2024-09-19T05:40:46.305875+0000","last_peered":"2024-09-19T05:40:46.305875+0000","last_clean":"2024-09-19T05:40:46.305875+0000","last_became_active":"2024-09-19T05:37:43.797964+0000","last_became_peered":"2024-09-19T05:37:43.797964+0000","last_unstale":"2024-09-19T05:40:46.305875+0000","last_undegraded":"2024-09-19T05:40:46.305875+0000","last_fullsized":"2024-09-19T05:40:46.305875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:46.305776+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:46.305776+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.305776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:53.242870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.296668+0000","last_change":"2024-09-19T05:40:48.296699+0000","last_active":"2024-09-19T05:40:48.296668+0000","last_peered":"2024-09-19T05:40:48.296668+0000","last_clean":"2024-09-19T05:40:48.296668+0000","last_became_active":"2024-09-19T05:37:43.799113+0000","last_became_peered":"2024-09-19T05:37:43.799113+0000","last_unstale":"2024-09-19T05:40:48.296668+0000","last_undegraded":"2024-09-19T05:40:48.296668+0000","last_fullsized":"2024-09-19T05:40:48.296668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:48.296581+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:48.296581+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.296581+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:58.116000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:34.260251+0000","last_change":"2024-09-19T05:40:34.260275+0000","last_active":"2024-09-19T05:40:34.260251+0000","last_peered":"2024-09-19T05:40:34.260251+0000","last_clean":"2024-09-19T05:40:34.260251+0000","last_became_active":"2024-09-19T05:37:43.787465+0000","last_became_peered":"2024-09-19T05:37:43.787465+0000","last_unstale":"2024-09-19T05:40:34.260251+0000","last_undegraded":"2024-09-19T05:40:34.260251+0000","last_fullsized":"2024-09-19T05:40:34.260251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:34.260181+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:34.260181+0000","last_clean_scrub_stamp":"2024-09-19T05:40:34.260181+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:22.732175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:39.497435+0000","last_change":"2024-09-19T05:40:39.497467+0000","last_active":"2024-09-19T05:40:39.497435+0000","last_peered":"2024-09-19T05:40:39.497435+0000","last_clean":"2024-09-19T05:40:39.497435+0000","last_became_active":"2024-09-19T05:37:43.789063+0000","last_became_peered":"2024-09-19T05:37:43.789063+0000","last_unstale":"2024-09-19T05:40:39.497435+0000","last_undegraded":"2024-09-19T05:40:39.497435+0000","last_fullsized":"2024-09-19T05:40:39.497435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:39.497339+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:39.497339+0000","last_clean_scrub_stamp":"2024-09-19T05:40:39.497339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:58:23.207008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:35.859702+0000","last_change":"2024-09-19T05:40:35.859744+0000","last_active":"2024-09-19T05:40:35.859702+0000","last_peered":"2024-09-19T05:40:35.859702+0000","last_clean":"2024-09-19T05:40:35.859702+0000","last_became_active":"2024-09-19T05:37:43.792263+0000","last_became_peered":"2024-09-19T05:37:43.792263+0000","last_unstale":"2024-09-19T05:40:35.859702+0000","last_undegraded":"2024-09-19T05:40:35.859702+0000","last_fullsized":"2024-09-19T05:40:35.859702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-19T05:40:35.859620+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-19T05:40:35.859620+0000","last_clean_scrub_stamp":"2024-09-19T05:40:35.859620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:00.570464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.608973+0000","last_change":"2024-09-19T05:40:40.608998+0000","last_active":"2024-09-19T05:40:40.608973+0000","last_peered":"2024-09-19T05:40:40.608973+0000","last_clean":"2024-09-19T05:40:40.608973+0000","last_became_active":"2024-09-19T05:37:43.793813+0000","last_became_peered":"2024-09-19T05:37:43.793813+0000","last_unstale":"2024-09-19T05:40:40.608973+0000","last_undegraded":"2024-09-19T05:40:40.608973+0000","last_fullsized":"2024-09-19T05:40:40.608973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:40.608893+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:40.608893+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.608893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:34.743578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:48.472748+0000","last_change":"2024-09-19T05:40:48.472792+0000","last_active":"2024-09-19T05:40:48.472748+0000","last_peered":"2024-09-19T05:40:48.472748+0000","last_clean":"2024-09-19T05:40:48.472748+0000","last_became_active":"2024-09-19T05:38:25.968320+0000","last_became_peered":"2024-09-19T05:38:25.968320+0000","last_unstale":"2024-09-19T05:40:48.472748+0000","last_undegraded":"2024-09-19T05:40:48.472748+0000","last_fullsized":"2024-09-19T05:40:48.472748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:48.472603+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:48.472603+0000","last_clean_scrub_stamp":"2024-09-19T05:40:48.472603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:36.427411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:46.460191+0000","last_change":"2024-09-19T05:40:46.460216+0000","last_active":"2024-09-19T05:40:46.460191+0000","last_peered":"2024-09-19T05:40:46.460191+0000","last_clean":"2024-09-19T05:40:46.460191+0000","last_became_active":"2024-09-19T05:37:43.801598+0000","last_became_peered":"2024-09-19T05:37:43.801598+0000","last_unstale":"2024-09-19T05:40:46.460191+0000","last_undegraded":"2024-09-19T05:40:46.460191+0000","last_fullsized":"2024-09-19T05:40:46.460191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-19T05:40:46.460109+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-19T05:40:46.460109+0000","last_clean_scrub_stamp":"2024-09-19T05:40:46.460109+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:27.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:52.431720+0000","last_change":"2024-09-19T05:40:52.431763+0000","last_active":"2024-09-19T05:40:52.431720+0000","last_peered":"2024-09-19T05:40:52.431720+0000","last_clean":"2024-09-19T05:40:52.431720+0000","last_became_active":"2024-09-19T05:37:43.799111+0000","last_became_peered":"2024-09-19T05:37:43.799111+0000","last_unstale":"2024-09-19T05:40:52.431720+0000","last_undegraded":"2024-09-19T05:40:52.431720+0000","last_fullsized":"2024-09-19T05:40:52.431720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-19T05:40:52.431603+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-19T05:40:52.431603+0000","last_clean_scrub_stamp":"2024-09-19T05:40:52.431603+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:28.228107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.870018+0000","last_change":"2024-09-19T05:40:44.870043+0000","last_active":"2024-09-19T05:40:44.870018+0000","last_peered":"2024-09-19T05:40:44.870018+0000","last_clean":"2024-09-19T05:40:44.870018+0000","last_became_active":"2024-09-19T05:37:43.791311+0000","last_became_peered":"2024-09-19T05:37:43.791311+0000","last_unstale":"2024-09-19T05:40:44.870018+0000","last_undegraded":"2024-09-19T05:40:44.870018+0000","last_fullsized":"2024-09-19T05:40:44.870018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-19T05:40:44.869931+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-19T05:40:44.869931+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.869931+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:18.243679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.415050+0000","last_change":"2024-09-19T05:40:50.415079+0000","last_active":"2024-09-19T05:40:50.415050+0000","last_peered":"2024-09-19T05:40:50.415050+0000","last_clean":"2024-09-19T05:40:50.415050+0000","last_became_active":"2024-09-19T05:37:43.794503+0000","last_became_peered":"2024-09-19T05:37:43.794503+0000","last_unstale":"2024-09-19T05:40:50.415050+0000","last_undegraded":"2024-09-19T05:40:50.415050+0000","last_fullsized":"2024-09-19T05:40:50.415050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-19T05:40:50.414969+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-19T05:40:50.414969+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.414969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:51.581914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:50.276819+0000","last_change":"2024-09-19T05:40:50.276848+0000","last_active":"2024-09-19T05:40:50.276819+0000","last_peered":"2024-09-19T05:40:50.276819+0000","last_clean":"2024-09-19T05:40:50.276819+0000","last_became_active":"2024-09-19T05:37:43.799656+0000","last_became_peered":"2024-09-19T05:37:43.799656+0000","last_unstale":"2024-09-19T05:40:50.276819+0000","last_undegraded":"2024-09-19T05:40:50.276819+0000","last_fullsized":"2024-09-19T05:40:50.276819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-19T05:40:50.276727+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-19T05:40:50.276727+0000","last_clean_scrub_stamp":"2024-09-19T05:40:50.276727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:18.165102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'4","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:37.480445+0000","last_change":"2024-09-19T05:40:37.480504+0000","last_active":"2024-09-19T05:40:37.480445+0000","last_peered":"2024-09-19T05:40:37.480445+0000","last_clean":"2024-09-19T05:40:37.480445+0000","last_became_active":"2024-09-19T05:37:43.792905+0000","last_became_peered":"2024-09-19T05:37:43.792905+0000","last_unstale":"2024-09-19T05:40:37.480445+0000","last_undegraded":"2024-09-19T05:40:37.480445+0000","last_fullsized":"2024-09-19T05:40:37.480445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:37.480323+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:37.480323+0000","last_clean_scrub_stamp":"2024-09-19T05:40:37.480323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:09.215908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:45.301337+0000","last_change":"2024-09-19T05:40:45.301379+0000","last_active":"2024-09-19T05:40:45.301337+0000","last_peered":"2024-09-19T05:40:45.301337+0000","last_clean":"2024-09-19T05:40:45.301337+0000","last_became_active":"2024-09-19T05:37:43.796457+0000","last_became_peered":"2024-09-19T05:37:43.796457+0000","last_unstale":"2024-09-19T05:40:45.301337+0000","last_undegraded":"2024-09-19T05:40:45.301337+0000","last_fullsized":"2024-09-19T05:40:45.301337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:45.301213+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:45.301213+0000","last_clean_scrub_stamp":"2024-09-19T05:40:45.301213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:22.704675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:40.479842+0000","last_change":"2024-09-19T05:40:40.479866+0000","last_active":"2024-09-19T05:40:40.479842+0000","last_peered":"2024-09-19T05:40:40.479842+0000","last_clean":"2024-09-19T05:40:40.479842+0000","last_became_active":"2024-09-19T05:37:43.793373+0000","last_became_peered":"2024-09-19T05:37:43.793373+0000","last_unstale":"2024-09-19T05:40:40.479842+0000","last_undegraded":"2024-09-19T05:40:40.479842+0000","last_fullsized":"2024-09-19T05:40:40.479842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-19T05:40:40.479748+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-19T05:40:40.479748+0000","last_clean_scrub_stamp":"2024-09-19T05:40:40.479748+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:06.847272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:44.345364+0000","last_change":"2024-09-19T05:40:44.345394+0000","last_active":"2024-09-19T05:40:44.345364+0000","last_peered":"2024-09-19T05:40:44.345364+0000","last_clean":"2024-09-19T05:40:44.345364+0000","last_became_active":"2024-09-19T05:37:43.790841+0000","last_became_peered":"2024-09-19T05:37:43.790841+0000","last_unstale":"2024-09-19T05:40:44.345364+0000","last_undegraded":"2024-09-19T05:40:44.345364+0000","last_fullsized":"2024-09-19T05:40:44.345364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-19T05:40:44.345273+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-19T05:40:44.345273+0000","last_clean_scrub_stamp":"2024-09-19T05:40:44.345273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:07.294573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-19T05:40:38.522039+0000","last_change":"2024-09-19T05:40:38.522073+0000","last_active":"2024-09-19T05:40:38.522039+0000","last_peered":"2024-09-19T05:40:38.522039+0000","last_clean":"2024-09-19T05:40:38.522039+0000","last_became_active":"2024-09-19T05:37:43.791366+0000","last_became_peered":"2024-09-19T05:37:43.791366+0000","last_unstale":"2024-09-19T05:40:38.522039+0000","last_undegraded":"2024-09-19T05:40:38.522039+0000","last_fullsized":"2024-09-19T05:40:38.522039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-19T05:40:38.521941+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-19T05:40:38.521941+0000","last_clean_scrub_stamp":"2024-09-19T05:40:38.521941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:04.126972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49294,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":264,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":98588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":718685,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":167715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":130149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":127547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":168161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":128091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":716875,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":42528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:41:17.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T05:41:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.916+0000 7fc1612a6640 1 Processor -- start 2024-09-19T05:41:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.916+0000 7fc1612a6640 1 -- start start 2024-09-19T05:41:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.916+0000 7fc1612a6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 0x7fc15c0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.916+0000 7fc1612a6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c0cc0d0 con 0x7fc15c15ae50 2024-09-19T05:41:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.916+0000 7fc1612a6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c0cc3b0 con 0x7fc15c15ed00 2024-09-19T05:41:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.916+0000 7fc1612a6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc15c0cbe80 con 0x7fc15c154f30 2024-09-19T05:41:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc15b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc15c15ae50 0x7fc15c15b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56602/0 (socket says 172.21.15.103:56602) 2024-09-19T05:41:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc15b7fe640 1 -- 172.21.15.103:0/3438359410 learned_addr learned my addr 172.21.15.103:0/3438359410 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:41:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 943352245 0 0) 0x7fc15c0cc0d0 con 0x7fc15c15ae50 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc144003520 con 0x7fc15c15ae50 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc15affd640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 0x7fc15c0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2783627253 0 0) 0x7fc144003520 con 0x7fc15c15ae50 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 msgr2=0x7fc15c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 0x7fc15c0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 >> v1:172.21.15.174:6789/0 conn(0x7fc15c15ed00 legacy=0x7fc15c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c0cb2b0 con 0x7fc15c15ae50 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fc1540019f0 con 0x7fc15c15ae50 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 >> v1:172.21.15.103:6789/0 conn(0x7fc15c15ae50 legacy=0x7fc15c15b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 0x7fc1440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc144004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc144004d40 0x7fc1440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c0cbe80 con 0x7fc144003f60 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc14400bb30 con 0x7fc144004d40 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc14400bd30 con 0x7fc15c154f30 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc15a7fc640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc144004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc15affd640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 0x7fc1440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.917+0000 7fc15b7fe640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc144004d40 0x7fc1440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.918+0000 7fc15a7fc640 1 -- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 msgr2=0x7fc1440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.918+0000 7fc15a7fc640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c154f30 0x7fc1440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.918+0000 7fc15a7fc640 1 -- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc144004d40 msgr2=0x7fc1440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.918+0000 7fc15a7fc640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc144004d40 0x7fc1440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.918+0000 7fc15a7fc640 1 -- 172.21.15.103:0/3438359410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc144003520 con 0x7fc144003f60 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.918+0000 7fc15a7fc640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc144004800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc150001720 tx=0x7fc144005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cc257c5231de5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150001370 con 0x7fc144003f60 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1500052d0 con 0x7fc144003f60 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc159ffb640 1 -- 172.21.15.103:0/3438359410 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15002abc0 con 0x7fc144003f60 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc1612a6640 1 -- 172.21.15.103:0/3438359410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 msgr2=0x7fc144004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc1612a6640 1 --2- 172.21.15.103:0/3438359410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc144004800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc150001720 tx=0x7fc144005830 comp rx=0 tx=0).stop 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc15b7fe640 1 -- 172.21.15.103:0/3438359410 reap_dead start 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc1612a6640 1 -- 172.21.15.103:0/3438359410 shutdown_connections 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc1612a6640 1 -- 172.21.15.103:0/3438359410 >> 172.21.15.103:0/3438359410 conn(0x7fc15c06bd10 msgr2=0x7fc15c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc1612a6640 1 -- 172.21.15.103:0/3438359410 shutdown_connections 2024-09-19T05:41:17.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.919+0000 7fc1612a6640 1 -- 172.21.15.103:0/3438359410 wait complete. 2024-09-19T05:41:17.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.920+0000 7fc1612a6640 1 Processor -- start 2024-09-19T05:41:17.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.920+0000 7fc1612a6640 1 -- start start 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc1612a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc15c1e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc1612a6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c0b60d0 0x7fc15c149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc1612a6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc15c1e4020 0x7fc15c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc1612a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c155310 con 0x7fc144003f60 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc1612a6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c0b3590 con 0x7fc15c1e4020 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc1612a6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc15c155490 con 0x7fc15c0b60d0 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc15affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc15c1e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc15affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc15c1e4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36986/0 (socket says 172.21.15.103:36986) 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc15affd640 1 -- 172.21.15.103:0/3181055763 learned_addr learned my addr 172.21.15.103:0/3181055763 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc15affd640 1 -- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c0b60d0 msgr2=0x7fc15c149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.921+0000 7fc15affd640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c0b60d0 0x7fc15c149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc15affd640 1 -- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc15c1e4020 msgr2=0x7fc15c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc15b7fe640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc15c1e4020 0x7fc15c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc15affd640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc15c1e4020 0x7fc15c0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc15affd640 1 -- 172.21.15.103:0/3181055763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c1f5090 con 0x7fc144003f60 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc15b7fe640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc15c1e4020 0x7fc15c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc15affd640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc15c1e4c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0119a0 tx=0x7fc14c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c00fa90 con 0x7fc144003f60 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c00fc30 con 0x7fc144003f60 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c014440 con 0x7fc144003f60 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c1f5330 con 0x7fc144003f60 2024-09-19T05:41:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.922+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15c0d0fd0 con 0x7fc144003f60 2024-09-19T05:41:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.923+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15c15f100 con 0x7fc144003f60 2024-09-19T05:41:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.924+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc14c012040 con 0x7fc144003f60 2024-09-19T05:41:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.924+0000 7fc1437fe640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc14806c2b0 0x7fc14806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.924+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc14c08bfa0 con 0x7fc144003f60 2024-09-19T05:41:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.924+0000 7fc15a7fc640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc14806c2b0 0x7fc14806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.924+0000 7fc15a7fc640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc14806c2b0 0x7fc14806e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc150032000 tx=0x7fc15002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:17.928+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc14c019030 con 0x7fc144003f60 2024-09-19T05:41:18.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.095+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc15c0cbc60 con 0x7fc144003f60 2024-09-19T05:41:18.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.100+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fc14c05a310 con 0x7fc144003f60 2024-09-19T05:41:18.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.101+0000 7fc1437fe640 1 -- 172.21.15.103:0/3181055763 <== mon.0 v2:172.21.15.103:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc14c059c10 con 0x7fc144003f60 2024-09-19T05:41:18.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc14806c2b0 msgr2=0x7fc14806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc14806c2b0 0x7fc14806e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc150032000 tx=0x7fc15002c000 comp rx=0 tx=0).stop 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 msgr2=0x7fc15c1e4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc15c1e4c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0119a0 tx=0x7fc14c011e60 comp rx=0 tx=0).stop 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 shutdown_connections 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fc14806c2b0 0x7fc14806e770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc15c1e4020 0x7fc15c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15c0b60d0 0x7fc15c149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 --2- 172.21.15.103:0/3181055763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc144003f60 0x7fc15c1e4c80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 >> 172.21.15.103:0/3181055763 conn(0x7fc15c06bd10 msgr2=0x7fc15c158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 shutdown_connections 2024-09-19T05:41:18.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.103+0000 7fc1612a6640 1 -- 172.21.15.103:0/3181055763 wait complete. 2024-09-19T05:41:18.117 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:41:18.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:41:18.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.212+0000 7f6070996640 1 Processor -- start 2024-09-19T05:41:18.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.212+0000 7f6070996640 1 -- start start 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.213+0000 7f6070996640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.213+0000 7f6070996640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f606c0c3a50 0x7f606c06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.213+0000 7f6070996640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f606c15bc80 con 0x7f606c0c46c0 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.213+0000 7f6070996640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f606c1585a0 con 0x7f606c0c3a50 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.213+0000 7f6070996640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f606c157c70 con 0x7f606c151ea0 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f606ad9d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f606c0c3a50 0x7f606c06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f606a59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f6069d9b640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f606c0c46c0 0x7f606c158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.103:57666/0 (socket says 172.21.15.103:57666) 2024-09-19T05:41:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f6069d9b640 1 -- 172.21.15.103:0/2224929433 learned_addr learned my addr 172.21.15.103:0/2224929433 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:41:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f606a59c640 1 -- 172.21.15.103:0/2224929433 >> v2:172.21.15.174:3300/0 conn(0x7f606c0c3a50 msgr2=0x7f606c06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f606a59c640 1 --2- 172.21.15.103:0/2224929433 >> v2:172.21.15.174:3300/0 conn(0x7f606c0c3a50 0x7f606c06eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f606a59c640 1 -- 172.21.15.103:0/2224929433 >> v1:172.21.15.174:6789/0 conn(0x7f606c0c46c0 legacy=0x7f606c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f606a59c640 1 -- 172.21.15.103:0/2224929433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606c157f50 con 0x7f606c151ea0 2024-09-19T05:41:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.214+0000 7f606ad9d640 1 --2- 172.21.15.103:0/2224929433 >> v2:172.21.15.174:3300/0 conn(0x7f606c0c3a50 0x7f606c06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:41:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.215+0000 7f606a59c640 1 --2- 172.21.15.103:0/2224929433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0c89b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60540097a0 tx=0x7f605402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd7afd9b356dc56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.215+0000 7f606959a640 1 -- 172.21.15.103:0/2224929433 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054037070 con 0x7f606c151ea0 2024-09-19T05:41:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.215+0000 7f606959a640 1 -- 172.21.15.103:0/2224929433 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6054032440 con 0x7f606c151ea0 2024-09-19T05:41:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.215+0000 7f606959a640 1 -- 172.21.15.103:0/2224929433 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054032830 con 0x7f606c151ea0 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 -- 172.21.15.103:0/2224929433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 msgr2=0x7f606c0c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 --2- 172.21.15.103:0/2224929433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0c89b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60540097a0 tx=0x7f605402a210 comp rx=0 tx=0).stop 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 -- 172.21.15.103:0/2224929433 shutdown_connections 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 --2- 172.21.15.103:0/2224929433 >> v2:172.21.15.174:3300/0 conn(0x7f606c0c3a50 0x7f606c06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 --2- 172.21.15.103:0/2224929433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0c89b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 -- 172.21.15.103:0/2224929433 >> 172.21.15.103:0/2224929433 conn(0x7f606c0c9230 msgr2=0x7f606c0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 -- 172.21.15.103:0/2224929433 shutdown_connections 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.216+0000 7f6070996640 1 -- 172.21.15.103:0/2224929433 wait complete. 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.217+0000 7f6070996640 1 Processor -- start 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.217+0000 7f6070996640 1 -- start start 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6070996640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f606c0c3a50 0x7f606c1e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6070996640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0c46c0 0x7f606c149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6070996640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6070996640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f606c1596e0 con 0x7f606c0c46c0 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6070996640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f606c152280 con 0x7f606c0c3a50 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6070996640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f606c158a30 con 0x7f606c151ea0 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0c46c0 0x7f606c149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0c46c0 0x7f606c149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36998/0 (socket says 172.21.15.103:36998) 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 -- 172.21.15.103:0/276513606 learned_addr learned my addr 172.21.15.103:0/276513606 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f606a59c640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f606c0c3a50 0x7f606c1e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f606ad9d640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 -- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 msgr2=0x7f606c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 -- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f606c0c3a50 msgr2=0x7f606c1e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f606c0c3a50 0x7f606c1e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 -- 172.21.15.103:0/276513606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606c148ec0 con 0x7f606c0c46c0 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f606ad9d640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.218+0000 7f6069d9b640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0c46c0 0x7f606c149890 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c370 tx=0x7f605c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.219+0000 7f6062ffd640 1 -- 172.21.15.103:0/276513606 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c017070 con 0x7f606c0c46c0 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.219+0000 7f6062ffd640 1 -- 172.21.15.103:0/276513606 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f605c005ce0 con 0x7f606c0c46c0 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.219+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606c1ee880 con 0x7f606c0c46c0 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.219+0000 7f6062ffd640 1 -- 172.21.15.103:0/276513606 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c007330 con 0x7f606c0c46c0 2024-09-19T05:41:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.219+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f606c1eee40 con 0x7f606c0c46c0 2024-09-19T05:41:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.220+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f606c15bf20 con 0x7f606c0c46c0 2024-09-19T05:41:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.220+0000 7f6062ffd640 1 -- 172.21.15.103:0/276513606 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f605c01a070 con 0x7f606c0c46c0 2024-09-19T05:41:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.221+0000 7f6062ffd640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f604c06c2b0 0x7f604c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.221+0000 7f6062ffd640 1 -- 172.21.15.103:0/276513606 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f605c08ab00 con 0x7f606c0c46c0 2024-09-19T05:41:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.221+0000 7f606a59c640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f604c06c2b0 0x7f604c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.221+0000 7f606a59c640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f604c06c2b0 0x7f604c06e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f605402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.225+0000 7f6062ffd640 1 -- 172.21.15.103:0/276513606 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f605c058790 con 0x7f606c0c46c0 2024-09-19T05:41:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.425+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f606c06c9e0 con 0x7f606c0c46c0 2024-09-19T05:41:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.426+0000 7f6062ffd640 1 -- 172.21.15.103:0/276513606 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6965 (secure 0 0 0) 0x7f605c05ca90 con 0x7f606c0c46c0 2024-09-19T05:41:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:41:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":18,"btime":"2024-09-19T05:38:28:967859+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:28.967854+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4241,4276,4302,4296,4299]},"id":1}]} 2024-09-19T05:41:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 18 2024-09-19T05:41:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f604c06c2b0 msgr2=0x7f604c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f604c06c2b0 0x7f604c06e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f605402e000 comp rx=0 tx=0).stop 2024-09-19T05:41:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0c46c0 msgr2=0x7f606c149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0c46c0 0x7f606c149890 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c370 tx=0x7f605c00c830 comp rx=0 tx=0).stop 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 shutdown_connections 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f604c06c2b0 0x7f604c06e770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606c151ea0 0x7f606c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0c46c0 0x7f606c149890 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 --2- 172.21.15.103:0/276513606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f606c0c3a50 0x7f606c1e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 >> 172.21.15.103:0/276513606 conn(0x7f606c0c9230 msgr2=0x7f606c06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 shutdown_connections 2024-09-19T05:41:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.428+0000 7f6070996640 1 -- 172.21.15.103:0/276513606 wait complete. 2024-09-19T05:41:18.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T05:41:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.537+0000 7fa6672dd640 1 Processor -- start 2024-09-19T05:41:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.538+0000 7fa6672dd640 1 -- start start 2024-09-19T05:41:18.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.538+0000 7fa6672dd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6600b3540 0x7fa6600cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.538+0000 7fa6672dd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6600c5950 0x7fa6600cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.538+0000 7fa6672dd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6600cbed0 con 0x7fa660155040 2024-09-19T05:41:18.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.538+0000 7fa6672dd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa66015bd70 con 0x7fa6600b3540 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.538+0000 7fa6672dd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600cbbf0 con 0x7fa6600c5950 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.538+0000 7fa664878640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6600b3540 0x7fa6600cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa664878640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6600b3540 0x7fa6600cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37002/0 (socket says 172.21.15.103:37002) 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa664878640 1 -- 172.21.15.103:0/3571941628 learned_addr learned my addr 172.21.15.103:0/3571941628 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa664878640 1 -- 172.21.15.103:0/3571941628 >> v2:172.21.15.174:3300/0 conn(0x7fa6600c5950 msgr2=0x7fa6600cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa66587a640 1 --2- 172.21.15.103:0/3571941628 >> v2:172.21.15.174:3300/0 conn(0x7fa6600c5950 0x7fa6600cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa664878640 1 --2- 172.21.15.103:0/3571941628 >> v2:172.21.15.174:3300/0 conn(0x7fa6600c5950 0x7fa6600cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa664878640 1 -- 172.21.15.103:0/3571941628 >> v1:172.21.15.103:6789/0 conn(0x7fa660155040 legacy=0x7fa66015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa664878640 1 -- 172.21.15.103:0/3571941628 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66015afb0 con 0x7fa6600b3540 2024-09-19T05:41:18.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.539+0000 7fa664878640 1 --2- 172.21.15.103:0/3571941628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600b3540 0x7fa6600cb540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa660158a00 tx=0x7fa65002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a724d58fa9f0e29e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa657fff640 1 -- 172.21.15.103:0/3571941628 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650037070 con 0x7fa6600b3540 2024-09-19T05:41:18.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa657fff640 1 -- 172.21.15.103:0/3571941628 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa65002ae50 con 0x7fa6600b3540 2024-09-19T05:41:18.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa657fff640 1 -- 172.21.15.103:0/3571941628 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650032880 con 0x7fa6600b3540 2024-09-19T05:41:18.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 -- 172.21.15.103:0/3571941628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600b3540 msgr2=0x7fa6600cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3571941628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600b3540 0x7fa6600cb540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa660158a00 tx=0x7fa65002a300 comp rx=0 tx=0).stop 2024-09-19T05:41:18.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 -- 172.21.15.103:0/3571941628 shutdown_connections 2024-09-19T05:41:18.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3571941628 >> v2:172.21.15.174:3300/0 conn(0x7fa6600c5950 0x7fa6600cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3571941628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600b3540 0x7fa6600cb540 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 -- 172.21.15.103:0/3571941628 >> 172.21.15.103:0/3571941628 conn(0x7fa660073340 msgr2=0x7fa660073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:18.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 -- 172.21.15.103:0/3571941628 shutdown_connections 2024-09-19T05:41:18.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.540+0000 7fa6672dd640 1 -- 172.21.15.103:0/3571941628 wait complete. 2024-09-19T05:41:18.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.541+0000 7fa6672dd640 1 Processor -- start 2024-09-19T05:41:18.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.541+0000 7fa6672dd640 1 -- start start 2024-09-19T05:41:18.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa6672dd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6600b3540 0x7fa66015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa6672dd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600c5950 0x7fa6600cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa6672dd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa660155040 0x7fa6601f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa6672dd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa66015b850 con 0x7fa6600c5950 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa6672dd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa66015b570 con 0x7fa660155040 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa6672dd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa66015eb30 con 0x7fa6600b3540 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa664878640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600c5950 0x7fa6600cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa664878640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600c5950 0x7fa6600cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37018/0 (socket says 172.21.15.103:37018) 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa664878640 1 -- 172.21.15.103:0/3574207859 learned_addr learned my addr 172.21.15.103:0/3574207859 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa66587a640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa660155040 0x7fa6601f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa665079640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6600b3540 0x7fa66015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.542+0000 7fa664878640 1 -- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6600b3540 msgr2=0x7fa66015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa664878640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6600b3540 0x7fa66015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa664878640 1 -- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa660155040 msgr2=0x7fa6601f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa664878640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa660155040 0x7fa6601f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa664878640 1 -- 172.21.15.103:0/3574207859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600d0540 con 0x7fa6600c5950 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa66587a640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa660155040 0x7fa6601f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa664878640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600c5950 0x7fa6600cf940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa65002a340 tx=0x7fa6500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa655ffb640 1 -- 172.21.15.103:0/3574207859 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650041070 con 0x7fa6600c5950 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa655ffb640 1 -- 172.21.15.103:0/3574207859 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa65003c870 con 0x7fa6600c5950 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66015a7a0 con 0x7fa6600c5950 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa655ffb640 1 -- 172.21.15.103:0/3574207859 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650037040 con 0x7fa6600c5950 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.543+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6600c9bb0 con 0x7fa6600c5950 2024-09-19T05:41:18.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.544+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6600c9ee0 con 0x7fa6600c5950 2024-09-19T05:41:18.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.545+0000 7fa655ffb640 1 -- 172.21.15.103:0/3574207859 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa650044070 con 0x7fa6600c5950 2024-09-19T05:41:18.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.545+0000 7fa655ffb640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa64406c2b0 0x7fa64406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.545+0000 7fa655ffb640 1 -- 172.21.15.103:0/3574207859 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa6500ac430 con 0x7fa6600c5950 2024-09-19T05:41:18.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.545+0000 7fa665079640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa64406c2b0 0x7fa64406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.546+0000 7fa665079640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa64406c2b0 0x7fa64406e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa65c001500 tx=0x7fa65c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.549+0000 7fa655ffb640 1 -- 172.21.15.103:0/3574207859 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa65007a830 con 0x7fa6600c5950 2024-09-19T05:41:18.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.748+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa660069380 con 0x7fa6600c5950 2024-09-19T05:41:18.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.749+0000 7fa655ffb640 1 -- 172.21.15.103:0/3574207859 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6965 (secure 0 0 0) 0x7fa65007a130 con 0x7fa6600c5950 2024-09-19T05:41:18.751 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:41:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":18,"btime":"2024-09-19T05:38:28:967859+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4008712770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4008712770},{"type":"v1","addr":"172.21.15.174:6834","nonce":4008712770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:37:43.118180+0000","modified":"2024-09-19T05:38:28.967854+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4302,"mds_1":4299,"mds_2":4296,"mds_3":4276,"mds_4":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.174:6835/623456066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":623456066},{"type":"v1","addr":"172.21.15.174:6835","nonce":623456066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.174:6837/604425908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":604425908},{"type":"v1","addr":"172.21.15.174:6837","nonce":604425908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6836/2341226700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2341226700},{"type":"v1","addr":"172.21.15.103:6836","nonce":2341226700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4299":{"gid":4299,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.103:6837/2009898073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2009898073},{"type":"v1","addr":"172.21.15.103:6837","nonce":2009898073}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4302":{"gid":4302,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/2567820767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2567820767},{"type":"v1","addr":"172.21.15.103:6839","nonce":2567820767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4241,4276,4302,4296,4299]},"id":1}]} 2024-09-19T05:41:18.752 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 18 2024-09-19T05:41:18.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa64406c2b0 msgr2=0x7fa64406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa64406c2b0 0x7fa64406e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa65c001500 tx=0x7fa65c009040 comp rx=0 tx=0).stop 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600c5950 msgr2=0x7fa6600cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600c5950 0x7fa6600cf940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa65002a340 tx=0x7fa6500046c0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 shutdown_connections 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fa64406c2b0 0x7fa64406e770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa660155040 0x7fa6601f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6600c5950 0x7fa6600cf940 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 --2- 172.21.15.103:0/3574207859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6600b3540 0x7fa66015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 >> 172.21.15.103:0/3574207859 conn(0x7fa660073340 msgr2=0x7fa6600cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 shutdown_connections 2024-09-19T05:41:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.751+0000 7fa6672dd640 1 -- 172.21.15.103:0/3574207859 wait complete. 2024-09-19T05:41:18.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:41:18.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.861+0000 7fb44674b640 1 Processor -- start 2024-09-19T05:41:18.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.861+0000 7fb44674b640 1 -- start start 2024-09-19T05:41:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb44674b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 0x7fb4400c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb44674b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44015bc80 con 0x7fb440151ea0 2024-09-19T05:41:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb44674b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb440157c70 con 0x7fb4400c3a50 2024-09-19T05:41:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb44674b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb4401585a0 con 0x7fb4400c46c0 2024-09-19T05:41:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43ffff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb440151ea0 0x7fb440158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56620/0 (socket says 172.21.15.103:56620) 2024-09-19T05:41:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43ffff640 1 -- 172.21.15.103:0/443864430 learned_addr learned my addr 172.21.15.103:0/443864430 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:41:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134025052 0 0) 0x7fb44015bc80 con 0x7fb440151ea0 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb428003520 con 0x7fb440151ea0 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43f7fe640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 0x7fb4400c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2070418487 0 0) 0x7fb428003520 con 0x7fb440151ea0 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 msgr2=0x7fb4400c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 0x7fb4400c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 >> v1:172.21.15.174:6789/0 conn(0x7fb4400c3a50 legacy=0x7fb44006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb440157f50 con 0x7fb440151ea0 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7fb430001670 con 0x7fb440151ea0 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 >> v1:172.21.15.103:6789/0 conn(0x7fb440151ea0 legacy=0x7fb440158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 0x7fb4280039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428003f60 0x7fb428004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.862+0000 7fb43effd640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb428004d40 0x7fb4280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401585a0 con 0x7fb428004d40 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb42800bb30 con 0x7fb428003f60 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb42800bd30 con 0x7fb4400c46c0 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb43ffff640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 0x7fb4280039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb444ce8640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb428004d40 0x7fb4280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb43f7fe640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428003f60 0x7fb428004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb444ce8640 1 -- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 msgr2=0x7fb4280039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb444ce8640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 0x7fb4280039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb444ce8640 1 -- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428003f60 msgr2=0x7fb428004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb444ce8640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428003f60 0x7fb428004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb444ce8640 1 -- 172.21.15.103:0/443864430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb428003520 con 0x7fb428004d40 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.863+0000 7fb43ffff640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4400c46c0 0x7fb4280039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb444ce8640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb428004d40 0x7fb4280051c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb438001e50 tx=0x7fb428005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe6133d545b60d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438001a70 con 0x7fb428004d40 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb438003970 con 0x7fb428004d40 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb43effd640 1 -- 172.21.15.103:0/443864430 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438003d80 con 0x7fb428004d40 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb44674b640 1 -- 172.21.15.103:0/443864430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb428004d40 msgr2=0x7fb4280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb44674b640 1 --2- 172.21.15.103:0/443864430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb428004d40 0x7fb4280051c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb438001e50 tx=0x7fb428005830 comp rx=0 tx=0).stop 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb444ce8640 1 -- 172.21.15.103:0/443864430 reap_dead start 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb44674b640 1 -- 172.21.15.103:0/443864430 shutdown_connections 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb44674b640 1 -- 172.21.15.103:0/443864430 >> 172.21.15.103:0/443864430 conn(0x7fb4400c9230 msgr2=0x7fb4400c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb44674b640 1 -- 172.21.15.103:0/443864430 shutdown_connections 2024-09-19T05:41:18.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.864+0000 7fb44674b640 1 -- 172.21.15.103:0/443864430 wait complete. 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.865+0000 7fb44674b640 1 Processor -- start 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb44674b640 1 -- start start 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb44674b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428004d40 0x7fb4400730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb44674b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb440073600 0x7fb44013d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb44674b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb44013dea0 0x7fb440134c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb44674b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401596e0 con 0x7fb44013dea0 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb44674b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb440152280 con 0x7fb428004d40 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb44674b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb440158a30 con 0x7fb440073600 2024-09-19T05:41:18.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb444ce8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb44013dea0 0x7fb440134c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb444ce8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb44013dea0 0x7fb440134c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37030/0 (socket says 172.21.15.103:37030) 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.866+0000 7fb444ce8640 1 -- 172.21.15.103:0/3346478444 learned_addr learned my addr 172.21.15.103:0/3346478444 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb43ffff640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428004d40 0x7fb4400730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb444ce8640 1 -- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb440073600 msgr2=0x7fb44013d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb43f7fe640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb440073600 0x7fb44013d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb444ce8640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb440073600 0x7fb44013d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb444ce8640 1 -- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428004d40 msgr2=0x7fb4400730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb444ce8640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428004d40 0x7fb4400730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb444ce8640 1 -- 172.21.15.103:0/3346478444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb440139990 con 0x7fb44013dea0 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb43ffff640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428004d40 0x7fb4400730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb43f7fe640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb440073600 0x7fb44013d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb444ce8640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb44013dea0 0x7fb440134c60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb438008fd0 tx=0x7fb4380014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb43cff9640 1 -- 172.21.15.103:0/3346478444 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438037040 con 0x7fb44013dea0 2024-09-19T05:41:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb43cff9640 1 -- 172.21.15.103:0/3346478444 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb438003e50 con 0x7fb44013dea0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb440139c30 con 0x7fb44013dea0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb43cff9640 1 -- 172.21.15.103:0/3346478444 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430007d30 con 0x7fb44013dea0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.867+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4400ca630 con 0x7fb44013dea0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.868+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4400c8520 con 0x7fb44013dea0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.869+0000 7fb43cff9640 1 -- 172.21.15.103:0/3346478444 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb438042020 con 0x7fb44013dea0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.869+0000 7fb43cff9640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb42c06c2e0 0x7fb42c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.869+0000 7fb43cff9640 1 -- 172.21.15.103:0/3346478444 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb4380aadc0 con 0x7fb44013dea0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.869+0000 7fb43ffff640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb42c06c2e0 0x7fb42c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.869+0000 7fb43ffff640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb42c06c2e0 0x7fb42c06e7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb430000fb0 tx=0x7fb430009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:18.873+0000 7fb43cff9640 1 -- 172.21.15.103:0/3346478444 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb4400c8520 con 0x7fb44013dea0 2024-09-19T05:41:19.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.043+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb44015bf20 con 0x7fb44013dea0 2024-09-19T05:41:19.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.044+0000 7fb43cff9640 1 -- 172.21.15.103:0/3346478444 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+19059 (secure 0 0 0) 0x7fb438079180 con 0x7fb44013dea0 2024-09-19T05:41:19.047 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-19T05:41:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"fsid":"a5534b78-3424-4071-a9f5-ce5e90eb5cb1","created":"2024-09-19T05:37:20.086250+0000","modified":"2024-09-19T05:38:25.956806+0000","last_up_change":"2024-09-19T05:37:31.194878+0000","last_in_change":"2024-09-19T05:37:22.160942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:37:32.203807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:37:40.937896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:37:42.096929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:37:45.811313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5e2c6e00-7e60-4ccc-9698-fca3ee448370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6801","nonce":3619190800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6803","nonce":3619190800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6807","nonce":3619190800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3619190800},{"type":"v1","addr":"172.21.15.103:6805","nonce":3619190800}]},"public_addr":"172.21.15.103:6801/3619190800","cluster_addr":"172.21.15.103:6803/3619190800","heartbeat_back_addr":"172.21.15.103:6807/3619190800","heartbeat_front_addr":"172.21.15.103:6805/3619190800","state":["exists","up"]},{"osd":1,"uuid":"8fff8c55-01de-40ad-81f1-750bf3f071b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6809","nonce":2116552185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6811","nonce":2116552185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6815","nonce":2116552185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2116552185},{"type":"v1","addr":"172.21.15.103:6813","nonce":2116552185}]},"public_addr":"172.21.15.103:6809/2116552185","cluster_addr":"172.21.15.103:6811/2116552185","heartbeat_back_addr":"172.21.15.103:6815/2116552185","heartbeat_front_addr":"172.21.15.103:6813/2116552185","state":["exists","up"]},{"osd":2,"uuid":"df45abe9-48ad-474d-ae64-3afa446097e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6825","nonce":2608335916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6827","nonce":2608335916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6831","nonce":2608335916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2608335916},{"type":"v1","addr":"172.21.15.103:6829","nonce":2608335916}]},"public_addr":"172.21.15.103:6825/2608335916","cluster_addr":"172.21.15.103:6827/2608335916","heartbeat_back_addr":"172.21.15.103:6831/2608335916","heartbeat_front_addr":"172.21.15.103:6829/2608335916","state":["exists","up"]},{"osd":3,"uuid":"76722d91-873a-4ddf-bee5-046bee9910e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6817","nonce":2269860310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6819","nonce":2269860310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6823","nonce":2269860310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2269860310},{"type":"v1","addr":"172.21.15.103:6821","nonce":2269860310}]},"public_addr":"172.21.15.103:6817/2269860310","cluster_addr":"172.21.15.103:6819/2269860310","heartbeat_back_addr":"172.21.15.103:6823/2269860310","heartbeat_front_addr":"172.21.15.103:6821/2269860310","state":["exists","up"]},{"osd":4,"uuid":"9fef5698-824f-4299-a7a6-86403a8063e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6825","nonce":1847922711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6827","nonce":1847922711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6831","nonce":1847922711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1847922711},{"type":"v1","addr":"172.21.15.174:6829","nonce":1847922711}]},"public_addr":"172.21.15.174:6825/1847922711","cluster_addr":"172.21.15.174:6827/1847922711","heartbeat_back_addr":"172.21.15.174:6831/1847922711","heartbeat_front_addr":"172.21.15.174:6829/1847922711","state":["exists","up"]},{"osd":5,"uuid":"99635d2e-a5f2-4993-8723-e9fdcc509ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6809","nonce":2844736294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6811","nonce":2844736294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6815","nonce":2844736294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2844736294},{"type":"v1","addr":"172.21.15.174:6813","nonce":2844736294}]},"public_addr":"172.21.15.174:6809/2844736294","cluster_addr":"172.21.15.174:6811/2844736294","heartbeat_back_addr":"172.21.15.174:6815/2844736294","heartbeat_front_addr":"172.21.15.174:6813/2844736294","state":["exists","up"]},{"osd":6,"uuid":"23082a6e-e556-4b08-839f-fd32d9fdf072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6817","nonce":2338063485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6819","nonce":2338063485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6823","nonce":2338063485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2338063485},{"type":"v1","addr":"172.21.15.174:6821","nonce":2338063485}]},"public_addr":"172.21.15.174:6817/2338063485","cluster_addr":"172.21.15.174:6819/2338063485","heartbeat_back_addr":"172.21.15.174:6823/2338063485","heartbeat_front_addr":"172.21.15.174:6821/2338063485","state":["exists","up"]},{"osd":7,"uuid":"a48c97e0-83a5-41b6-8f02-49a356e9a37b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6801","nonce":3833416163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6803","nonce":3833416163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6807","nonce":3833416163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":3833416163},{"type":"v1","addr":"172.21.15.174:6805","nonce":3833416163}]},"public_addr":"172.21.15.174:6801/3833416163","cluster_addr":"172.21.15.174:6803/3833416163","heartbeat_back_addr":"172.21.15.174:6807/3833416163","heartbeat_front_addr":"172.21.15.174:6805/3833416163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.497871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.709409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.862395+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.236198+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:29.010384+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.461789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.982643+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:37:28.476405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb42c06c2e0 msgr2=0x7fb42c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb42c06c2e0 0x7fb42c06e7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb430000fb0 tx=0x7fb430009040 comp rx=0 tx=0).stop 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb44013dea0 msgr2=0x7fb440134c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb44013dea0 0x7fb440134c60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb438008fd0 tx=0x7fb4380014a0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 shutdown_connections 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7fb42c06c2e0 0x7fb42c06e7a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb44013dea0 0x7fb440134c60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb440073600 0x7fb44013d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 --2- 172.21.15.103:0/3346478444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb428004d40 0x7fb4400730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 >> 172.21.15.103:0/3346478444 conn(0x7fb4400c9230 msgr2=0x7fb44006ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 shutdown_connections 2024-09-19T05:41:19.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.046+0000 7fb44674b640 1 -- 172.21.15.103:0/3346478444 wait complete. 2024-09-19T05:41:19.060 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T05:41:19.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.158+0000 7f7a9be4c640 1 Processor -- start 2024-09-19T05:41:19.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.158+0000 7f7a9be4c640 1 -- start start 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a9be4c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 0x7f7a940ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a9be4c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a94074350 con 0x7f7a94152f00 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a9be4c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a94074610 con 0x7f7a940cab90 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a9be4c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7a940c8cc0 con 0x7f7a940ce6a0 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a99be8640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7a94152f00 0x7f7a94073c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56634/0 (socket says 172.21.15.103:56634) 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a99be8640 1 -- 172.21.15.103:0/3642447358 learned_addr learned my addr 172.21.15.103:0/3642447358 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531097062 0 0) 0x7f7a94074350 con 0x7f7a94152f00 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a80003520 con 0x7f7a94152f00 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a9a3e9640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 0x7f7a940ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2340172033 0 0) 0x7f7a80003520 con 0x7f7a94152f00 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 msgr2=0x7f7a940ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 0x7f7a940ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 >> v1:172.21.15.174:6789/0 conn(0x7f7a940cab90 legacy=0x7f7a9415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a940c7f00 con 0x7f7a94152f00 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f7a90001670 con 0x7f7a94152f00 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 >> v1:172.21.15.103:6789/0 conn(0x7f7a94152f00 legacy=0x7f7a94073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 0x7f7a800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a80004010 0x7f7a80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940c8cc0 con 0x7f7a80004d40 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8000bb80 con 0x7f7a80004010 2024-09-19T05:41:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.159+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8000bd80 con 0x7f7a940ce6a0 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a9a3e9640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a993e7640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a80004010 0x7f7a80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a99be8640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 0x7f7a800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a9a3e9640 1 -- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 msgr2=0x7f7a800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a9a3e9640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 0x7f7a800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a9a3e9640 1 -- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a80004010 msgr2=0x7f7a80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a9a3e9640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a80004010 0x7f7a80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a9a3e9640 1 -- 172.21.15.103:0/3642447358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a80003520 con 0x7f7a80004d40 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.160+0000 7f7a99be8640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ce6a0 0x7f7a800039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9a3e9640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a800051c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007360 tx=0x7f7a80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65887f1232afa9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c009be0 con 0x7f7a80004d40 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7a8c036600 con 0x7f7a80004d40 2024-09-19T05:41:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a98be6640 1 -- 172.21.15.103:0/3642447358 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0369f0 con 0x7f7a80004d40 2024-09-19T05:41:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3642447358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 msgr2=0x7f7a800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9be4c640 1 --2- 172.21.15.103:0/3642447358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a800051c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007360 tx=0x7f7a80005830 comp rx=0 tx=0).stop 2024-09-19T05:41:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9a3e9640 1 -- 172.21.15.103:0/3642447358 reap_dead start 2024-09-19T05:41:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3642447358 shutdown_connections 2024-09-19T05:41:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3642447358 >> 172.21.15.103:0/3642447358 conn(0x7f7a9406c240 msgr2=0x7f7a94067890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3642447358 shutdown_connections 2024-09-19T05:41:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.161+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3642447358 wait complete. 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 Processor -- start 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 -- start start 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a9414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ba0c0 0x7f7a940c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a941f0e40 0x7f7a941f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940c87a0 con 0x7f7a80004d40 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940c84c0 con 0x7f7a941f0e40 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a9be4c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7a94073710 con 0x7f7a940ba0c0 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a99be8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a9414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a99be8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a9414fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37040/0 (socket says 172.21.15.103:37040) 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.163+0000 7f7a99be8640 1 -- 172.21.15.103:0/3119807708 learned_addr learned my addr 172.21.15.103:0/3119807708 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a9a3e9640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a941f0e40 0x7f7a941f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a993e7640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ba0c0 0x7f7a940c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a99be8640 1 -- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ba0c0 msgr2=0x7f7a940c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a99be8640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ba0c0 0x7f7a940c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a99be8640 1 -- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a941f0e40 msgr2=0x7f7a941f12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a99be8640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a941f0e40 0x7f7a941f12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a99be8640 1 -- 172.21.15.103:0/3119807708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9414f1c0 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a993e7640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ba0c0 0x7f7a940c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a99be8640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a9414fdc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000e920 tx=0x7f7a9000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a8a7fc640 1 -- 172.21.15.103:0/3119807708 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90019070 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a8a7fc640 1 -- 172.21.15.103:0/3119807708 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7a90005260 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9414ef00 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a8a7fc640 1 -- 172.21.15.103:0/3119807708 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90005650 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.164+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9414fa80 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.165+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a941532e0 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.165+0000 7f7a8a7fc640 1 -- 172.21.15.103:0/3119807708 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a9001c070 con 0x7f7a80004d40 2024-09-19T05:41:19.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.166+0000 7f7a8a7fc640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f7a7806c2b0 0x7f7a7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.166+0000 7f7a8a7fc640 1 -- 172.21.15.103:0/3119807708 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f7a9008b260 con 0x7f7a80004d40 2024-09-19T05:41:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.166+0000 7f7a993e7640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f7a7806c2b0 0x7f7a7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.166+0000 7f7a993e7640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f7a7806c2b0 0x7f7a7806e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a941e62a0 tx=0x7f7a84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:19.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.170+0000 7f7a8a7fc640 1 -- 172.21.15.103:0/3119807708 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7a90058ef0 con 0x7f7a80004d40 2024-09-19T05:41:19.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.369+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a940cba50 con 0x7f7a80004d40 2024-09-19T05:41:19.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.371+0000 7f7a8a7fc640 1 -- 172.21.15.103:0/3119807708 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f7a9005d1f0 con 0x7f7a80004d40 2024-09-19T05:41:19.374 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:41:19.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f7a7806c2b0 msgr2=0x7f7a7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f7a7806c2b0 0x7f7a7806e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a941e62a0 tx=0x7f7a84009040 comp rx=0 tx=0).stop 2024-09-19T05:41:19.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 msgr2=0x7f7a9414fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a9414fdc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000e920 tx=0x7f7a9000ede0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 shutdown_connections 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f7a7806c2b0 0x7f7a7806e770 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a941e62a0 tx=0x7f7a84009040 comp rx=0 tx=0).stop 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a941f0e40 0x7f7a941f12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a940ba0c0 0x7f7a940c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 --2- 172.21.15.103:0/3119807708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a80004d40 0x7f7a9414fdc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 >> 172.21.15.103:0/3119807708 conn(0x7f7a9406c240 msgr2=0x7f7a94151740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 shutdown_connections 2024-09-19T05:41:19.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.375+0000 7f7a9be4c640 1 -- 172.21.15.103:0/3119807708 wait complete. 2024-09-19T05:41:19.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:41:19.411 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-09-19T05:41:19.412 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-19T05:41:19.412 INFO:tasks.ceph.mds.f.smithi174.stdout:starting mds.f at 2024-09-19T05:41:19.413 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-19T05:41:19.416 INFO:tasks.ceph.mds.e.smithi103.stdout:starting mds.e at 2024-09-19T05:41:19.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.495+0000 7f8ddf19f640 1 Processor -- start 2024-09-19T05:41:19.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.495+0000 7f8ddf19f640 1 -- start start 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddf19f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8dd8073e30 0x7f8dd80b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddf19f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8dd80cd840 0x7f8dd815b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddf19f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd80cdcb0 con 0x7f8dd8073340 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddf19f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd80ccb10 con 0x7f8dd80cd840 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddf19f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd80cbb40 con 0x7f8dd8073e30 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddd73c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8dd80cd840 0x7f8dd815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddd73c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8dd80cd840 0x7f8dd815b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37112/0 (socket says 172.21.15.103:37112) 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.496+0000 7f8ddd73c640 1 -- 172.21.15.103:0/2646452084 learned_addr learned my addr 172.21.15.103:0/2646452084 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8dd7fff640 1 --2- 172.21.15.103:0/2646452084 >> v2:172.21.15.174:3300/0 conn(0x7f8dd8073e30 0x7f8dd80b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8ddd73c640 1 -- 172.21.15.103:0/2646452084 >> v2:172.21.15.174:3300/0 conn(0x7f8dd8073e30 msgr2=0x7f8dd80b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8ddd73c640 1 --2- 172.21.15.103:0/2646452084 >> v2:172.21.15.174:3300/0 conn(0x7f8dd8073e30 0x7f8dd80b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8ddd73c640 1 -- 172.21.15.103:0/2646452084 >> v1:172.21.15.174:6789/0 conn(0x7f8dd8073340 legacy=0x7f8dd8073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8ddd73c640 1 -- 172.21.15.103:0/2646452084 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd80cbde0 con 0x7f8dd80cd840 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8dd7fff640 1 --2- 172.21.15.103:0/2646452084 >> v2:172.21.15.174:3300/0 conn(0x7f8dd8073e30 0x7f8dd80b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8ddd73c640 1 --2- 172.21.15.103:0/2646452084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd80cd840 0x7f8dd815b830 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b3fb0 tx=0x7f8dc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1af569a7602898d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.497+0000 7f8dd77fe640 1 -- 172.21.15.103:0/2646452084 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0037070 con 0x7f8dd80cd840 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8dd77fe640 1 -- 172.21.15.103:0/2646452084 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8dc0032440 con 0x7f8dd80cd840 2024-09-19T05:41:19.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8dd77fe640 1 -- 172.21.15.103:0/2646452084 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0032830 con 0x7f8dd80cd840 2024-09-19T05:41:19.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 -- 172.21.15.103:0/2646452084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd80cd840 msgr2=0x7f8dd815b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/2646452084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd80cd840 0x7f8dd815b830 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b3fb0 tx=0x7f8dc002a270 comp rx=0 tx=0).stop 2024-09-19T05:41:19.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 -- 172.21.15.103:0/2646452084 shutdown_connections 2024-09-19T05:41:19.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/2646452084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd80cd840 0x7f8dd815b830 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/2646452084 >> v2:172.21.15.174:3300/0 conn(0x7f8dd8073e30 0x7f8dd80b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 -- 172.21.15.103:0/2646452084 >> 172.21.15.103:0/2646452084 conn(0x7f8dd806d830 msgr2=0x7f8dd806dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:19.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 -- 172.21.15.103:0/2646452084 shutdown_connections 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.498+0000 7f8ddf19f640 1 -- 172.21.15.103:0/2646452084 wait complete. 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.499+0000 7f8ddf19f640 1 Processor -- start 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.499+0000 7f8ddf19f640 1 -- start start 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddf19f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd8073340 0x7f8dd80c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddf19f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8073e30 0x7f8dd81f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddf19f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cd840 0x7f8dd814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddf19f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd80cd040 con 0x7f8dd8073340 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddf19f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd80ccd60 con 0x7f8dd80cd840 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddf19f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd80cd320 con 0x7f8dd8073e30 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddcf3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd8073340 0x7f8dd80c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddcf3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd8073340 0x7f8dd80c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37122/0 (socket says 172.21.15.103:37122) 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddcf3b640 1 -- 172.21.15.103:0/3301269225 learned_addr learned my addr 172.21.15.103:0/3301269225 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:19.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8ddd73c640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cd840 0x7f8dd814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.500+0000 7f8dd7fff640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8073e30 0x7f8dd81f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddcf3b640 1 -- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8073e30 msgr2=0x7f8dd81f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddcf3b640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8073e30 0x7f8dd81f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddcf3b640 1 -- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cd840 msgr2=0x7f8dd814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddcf3b640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cd840 0x7f8dd814a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddcf3b640 1 -- 172.21.15.103:0/3301269225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd81f5120 con 0x7f8dd8073340 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddcf3b640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd8073340 0x7f8dd80c68e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000c3c0 tx=0x7f8dd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8dd57fa640 1 -- 172.21.15.103:0/3301269225 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00052d0 con 0x7f8dd8073340 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8dd57fa640 1 -- 172.21.15.103:0/3301269225 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8dd0005490 con 0x7f8dd8073340 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8dd57fa640 1 -- 172.21.15.103:0/3301269225 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0007280 con 0x7f8dd8073340 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd815bca0 con 0x7f8dd8073340 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.501+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd81f4360 con 0x7f8dd8073340 2024-09-19T05:41:19.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.502+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd80cdfa0 con 0x7f8dd8073340 2024-09-19T05:41:19.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.502+0000 7f8dd57fa640 1 -- 172.21.15.103:0/3301269225 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8dd0007420 con 0x7f8dd8073340 2024-09-19T05:41:19.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.503+0000 7f8dd57fa640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8db806c2b0 0x7f8db806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:19.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.503+0000 7f8dd57fa640 1 -- 172.21.15.103:0/3301269225 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 7165+0+0 (secure 0 0 0) 0x7f8dd008aea0 con 0x7f8dd8073340 2024-09-19T05:41:19.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.503+0000 7f8dd7fff640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8db806c2b0 0x7f8db806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:19.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.503+0000 7f8dd7fff640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8db806c2b0 0x7f8db806e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dd81ee8f0 tx=0x7f8dc80097f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:19.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.507+0000 7f8dd57fa640 1 -- 172.21.15.103:0/3301269225 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8dd0058980 con 0x7f8dd8073340 2024-09-19T05:41:19.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:19.704+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8dd80cc430 con 0x7f8dd8073340 2024-09-19T05:41:20.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.373+0000 7f8dd57fa640 1 -- 172.21.15.103:0/3301269225 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f8dd005cc80 con 0x7f8dd8073340 2024-09-19T05:41:20.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8db806c2b0 msgr2=0x7f8db806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:20.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8db806c2b0 0x7f8db806e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dd81ee8f0 tx=0x7f8dc80097f0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd8073340 msgr2=0x7f8dd80c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:20.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd8073340 0x7f8dd80c68e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000c3c0 tx=0x7f8dd000c880 comp rx=0 tx=0).stop 2024-09-19T05:41:20.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 shutdown_connections 2024-09-19T05:41:20.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f8db806c2b0 0x7f8db806e770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cd840 0x7f8dd814a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8073e30 0x7f8dd81f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 --2- 172.21.15.103:0/3301269225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd8073340 0x7f8dd80c68e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 >> 172.21.15.103:0/3301269225 conn(0x7f8dd806d830 msgr2=0x7f8dd806dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 shutdown_connections 2024-09-19T05:41:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.375+0000 7f8ddf19f640 1 -- 172.21.15.103:0/3301269225 wait complete. 2024-09-19T05:41:20.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:41:20.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.535+0000 7f9bffb78640 1 Processor -- start 2024-09-19T05:41:20.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.535+0000 7f9bffb78640 1 -- start start 2024-09-19T05:41:20.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bffb78640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bf8154f90 0x7f9bf80c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:20.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bffb78640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9bf8067890 0x7f9bf806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:20.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bffb78640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf80c8f30 0x7f9bf80c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:20.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bffb78640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf80c32f0 con 0x7f9bf8154f90 2024-09-19T05:41:20.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bffb78640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf815b8f0 con 0x7f9bf8067890 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bffb78640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf815bb50 con 0x7f9bf80c8f30 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd914640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bf8154f90 0x7f9bf80c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd914640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bf8154f90 0x7f9bf80c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37134/0 (socket says 172.21.15.103:37134) 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd914640 1 -- 172.21.15.103:0/3779575227 learned_addr learned my addr 172.21.15.103:0/3779575227 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfe115640 1 --2- 172.21.15.103:0/3779575227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf80c8f30 0x7f9bf80c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd113640 1 --2- 172.21.15.103:0/3779575227 >> v2:172.21.15.174:3300/0 conn(0x7f9bf8067890 0x7f9bf806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd914640 1 -- 172.21.15.103:0/3779575227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf80c8f30 msgr2=0x7f9bf80c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd914640 1 --2- 172.21.15.103:0/3779575227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf80c8f30 0x7f9bf80c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd914640 1 -- 172.21.15.103:0/3779575227 >> v2:172.21.15.174:3300/0 conn(0x7f9bf8067890 msgr2=0x7f9bf806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.536+0000 7f9bfd914640 1 --2- 172.21.15.103:0/3779575227 >> v2:172.21.15.174:3300/0 conn(0x7f9bf8067890 0x7f9bf806d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.537+0000 7f9bfd914640 1 -- 172.21.15.103:0/3779575227 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf80c2050 con 0x7f9bf8154f90 2024-09-19T05:41:20.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.537+0000 7f9bfd914640 1 --2- 172.21.15.103:0/3779575227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf8154f90 0x7f9bf80c2b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80b2bb0 tx=0x7f9bf402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8ef7281fcf9651 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:20.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.537+0000 7f9bfc912640 1 -- 172.21.15.103:0/3779575227 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4037070 con 0x7f9bf8154f90 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.537+0000 7f9bfc912640 1 -- 172.21.15.103:0/3779575227 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9bf4032440 con 0x7f9bf8154f90 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.537+0000 7f9bfc912640 1 -- 172.21.15.103:0/3779575227 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4032830 con 0x7f9bf8154f90 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 -- 172.21.15.103:0/3779575227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf8154f90 msgr2=0x7f9bf80c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 --2- 172.21.15.103:0/3779575227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf8154f90 0x7f9bf80c2b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80b2bb0 tx=0x7f9bf402a2a0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 -- 172.21.15.103:0/3779575227 shutdown_connections 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 --2- 172.21.15.103:0/3779575227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf80c8f30 0x7f9bf80c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 --2- 172.21.15.103:0/3779575227 >> v2:172.21.15.174:3300/0 conn(0x7f9bf8067890 0x7f9bf806d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 --2- 172.21.15.103:0/3779575227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf8154f90 0x7f9bf80c2b30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 -- 172.21.15.103:0/3779575227 >> 172.21.15.103:0/3779575227 conn(0x7f9bf80c9920 msgr2=0x7f9bf80c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 -- 172.21.15.103:0/3779575227 shutdown_connections 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.538+0000 7f9bffb78640 1 -- 172.21.15.103:0/3779575227 wait complete. 2024-09-19T05:41:20.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.539+0000 7f9bffb78640 1 Processor -- start 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.539+0000 7f9bffb78640 1 -- start start 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bffb78640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf8067890 0x7f9bf80b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bffb78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf80c8f30 0x7f9bf80aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bffb78640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf8154f90 0x7f9bf80b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bffb78640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf8070530 con 0x7f9bf80c8f30 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bffb78640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf80c2610 con 0x7f9bf8154f90 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bffb78640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf80c93c0 con 0x7f9bf8067890 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf80c8f30 0x7f9bf80aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf80c8f30 0x7f9bf80aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37150/0 (socket says 172.21.15.103:37150) 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 -- 172.21.15.103:0/2389844947 learned_addr learned my addr 172.21.15.103:0/2389844947 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd914640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf8067890 0x7f9bf80b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfe115640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf8154f90 0x7f9bf80b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 -- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf8067890 msgr2=0x7f9bf80b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf8067890 0x7f9bf80b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 -- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf8154f90 msgr2=0x7f9bf80b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf8154f90 0x7f9bf80b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 -- 172.21.15.103:0/2389844947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf81f1dc0 con 0x7f9bf80c8f30 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd914640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf8067890 0x7f9bf80b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bfd113640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf80c8f30 0x7f9bf80aff10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9be800d830 tx=0x7f9be800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bee7fc640 1 -- 172.21.15.103:0/2389844947 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be800b6c0 con 0x7f9bf80c8f30 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bee7fc640 1 -- 172.21.15.103:0/2389844947 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9be8019070 con 0x7f9bf80c8f30 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.540+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf81f1240 con 0x7f9bf80c8f30 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.541+0000 7f9bee7fc640 1 -- 172.21.15.103:0/2389844947 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be800baa0 con 0x7f9bf80c8f30 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.541+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf81f1800 con 0x7f9bf80c8f30 2024-09-19T05:41:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.542+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf80693d0 con 0x7f9bf80c8f30 2024-09-19T05:41:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.542+0000 7f9bee7fc640 1 -- 172.21.15.103:0/2389844947 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9be801e460 con 0x7f9bf80c8f30 2024-09-19T05:41:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.543+0000 7f9bee7fc640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9bdc06c2e0 0x7f9bdc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.543+0000 7f9bfd914640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9bdc06c2e0 0x7f9bdc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.543+0000 7f9bee7fc640 1 -- 172.21.15.103:0/2389844947 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 7165+0+0 (secure 0 0 0) 0x7f9be808c130 con 0x7f9bf80c8f30 2024-09-19T05:41:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.543+0000 7f9bfd914640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9bdc06c2e0 0x7f9bdc06e7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4034000 tx=0x7f9bf402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.547+0000 7f9bee7fc640 1 -- 172.21.15.103:0/2389844947 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9be805a260 con 0x7f9bf80c8f30 2024-09-19T05:41:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:20.714+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9bf80c8640 con 0x7f9bf80c8f30 2024-09-19T05:41:21.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.382+0000 7f9bee7fc640 1 -- 172.21.15.103:0/2389844947 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7f9be8059b60 con 0x7f9bf80c8f30 2024-09-19T05:41:21.384 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9bdc06c2e0 msgr2=0x7f9bdc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9bdc06c2e0 0x7f9bdc06e7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4034000 tx=0x7f9bf402e000 comp rx=0 tx=0).stop 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf80c8f30 msgr2=0x7f9bf80aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf80c8f30 0x7f9bf80aff10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9be800d830 tx=0x7f9be800dcf0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 shutdown_connections 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f9bdc06c2e0 0x7f9bdc06e7a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf8154f90 0x7f9bf80b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf80c8f30 0x7f9bf80aff10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 --2- 172.21.15.103:0/2389844947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf8067890 0x7f9bf80b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 >> 172.21.15.103:0/2389844947 conn(0x7f9bf80c9920 msgr2=0x7f9bf80c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:21.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 shutdown_connections 2024-09-19T05:41:21.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.384+0000 7f9bffb78640 1 -- 172.21.15.103:0/2389844947 wait complete. 2024-09-19T05:41:21.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:41:21.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.506+0000 7f00b564c640 1 Processor -- start 2024-09-19T05:41:21.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.506+0000 7f00b564c640 1 -- start start 2024-09-19T05:41:21.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.507+0000 7f00b564c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 0x7f00b0158b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.507+0000 7f00b564c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b00c69c0 con 0x7f00b00c8810 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.507+0000 7f00b564c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b00c8c90 con 0x7f00b00c55c0 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.507+0000 7f00b564c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f00b0153290 con 0x7f00b0152eb0 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.507+0000 7f00af7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f00b00c8810 0x7f00b0071490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40186/0 (socket says 172.21.15.103:40186) 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.507+0000 7f00af7fe640 1 -- 172.21.15.103:0/1381231311 learned_addr learned my addr 172.21.15.103:0/1381231311 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.507+0000 7f00aeffd640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 0x7f00b0158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322567789 0 0) 0x7f00b00c69c0 con 0x7f00b00c8810 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0098003520 con 0x7f00b00c8810 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130829967 0 0) 0x7f00b00c8c90 con 0x7f00b00c55c0 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b00c69c0 con 0x7f00b00c55c0 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2259875006 0 0) 0x7f0098003520 con 0x7f00b00c8810 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 msgr2=0x7f00b0158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 0x7f00b0158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 >> v1:172.21.15.174:6789/0 conn(0x7f00b00c55c0 legacy=0x7f00b00c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b00c8030 con 0x7f00b00c8810 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4087018851 0 0) 0x7f00a8001670 con 0x7f00b00c8810 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 >> v1:172.21.15.103:6789/0 conn(0x7f00b00c8810 legacy=0x7f00b0071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 0x7f0098003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0098004120 0x7f0098004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0098004d40 0x7f00980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00b0153290 con 0x7f0098004120 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f009800bb00 con 0x7f0098004d40 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f009800bd00 con 0x7f00b0152eb0 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00aeffd640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 0x7f0098003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00ae7fc640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0098004120 0x7f0098004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00af7fe640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0098004d40 0x7f00980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00ae7fc640 1 -- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 msgr2=0x7f0098003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00ae7fc640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00b0152eb0 0x7f0098003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00ae7fc640 1 -- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0098004d40 msgr2=0x7f00980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00ae7fc640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0098004d40 0x7f00980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.508+0000 7f00ae7fc640 1 -- 172.21.15.103:0/1381231311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0098003520 con 0x7f0098004120 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.509+0000 7f00ae7fc640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0098004120 0x7f0098004800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f00a40018a0 tx=0x7f0098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e58cec797a3272 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.509+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a40014f0 con 0x7f0098004120 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.509+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f00a40052d0 con 0x7f0098004120 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.509+0000 7f00adffb640 1 -- 172.21.15.103:0/1381231311 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a402abb0 con 0x7f0098004120 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.510+0000 7f00b564c640 1 -- 172.21.15.103:0/1381231311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0098004120 msgr2=0x7f0098004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.510+0000 7f00b564c640 1 --2- 172.21.15.103:0/1381231311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0098004120 0x7f0098004800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f00a40018a0 tx=0x7f0098005830 comp rx=0 tx=0).stop 2024-09-19T05:41:21.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.510+0000 7f00af7fe640 1 -- 172.21.15.103:0/1381231311 reap_dead start 2024-09-19T05:41:21.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.510+0000 7f00b564c640 1 -- 172.21.15.103:0/1381231311 shutdown_connections 2024-09-19T05:41:21.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.510+0000 7f00b564c640 1 -- 172.21.15.103:0/1381231311 >> 172.21.15.103:0/1381231311 conn(0x7f00b006f730 msgr2=0x7f00b006fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:21.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.510+0000 7f00b564c640 1 -- 172.21.15.103:0/1381231311 shutdown_connections 2024-09-19T05:41:21.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.510+0000 7f00b564c640 1 -- 172.21.15.103:0/1381231311 wait complete. 2024-09-19T05:41:21.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.511+0000 7f00b564c640 1 Processor -- start 2024-09-19T05:41:21.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.511+0000 7f00b564c640 1 -- start start 2024-09-19T05:41:21.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00b564c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0098004120 0x7f00b01f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00b564c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b01561e0 0x7f00b0146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00b564c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b015b5c0 0x7f00b0146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00b564c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00b00c66e0 con 0x7f00b015b5c0 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00b564c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f00b00c6400 con 0x7f00b01561e0 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00b564c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f00b00c82f0 con 0x7f0098004120 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b015b5c0 0x7f00b0146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b015b5c0 0x7f00b0146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51302/0 (socket says 172.21.15.103:51302) 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 -- 172.21.15.103:0/1552897536 learned_addr learned my addr 172.21.15.103:0/1552897536 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00ae7fc640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b01561e0 0x7f00b0146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00aeffd640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0098004120 0x7f00b01f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 -- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0098004120 msgr2=0x7f00b01f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0098004120 0x7f00b01f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 -- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b01561e0 msgr2=0x7f00b0146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b01561e0 0x7f00b0146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 -- 172.21.15.103:0/1552897536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b0146400 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00af7fe640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b015b5c0 0x7f00b0146b90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f00b00c6b90 tx=0x7f00a8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00977fe640 1 -- 172.21.15.103:0/1552897536 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a800f700 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00977fe640 1 -- 172.21.15.103:0/1552897536 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f00a8018070 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b0146120 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.512+0000 7f00977fe640 1 -- 172.21.15.103:0/1552897536 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a800fb20 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.513+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b01f0c40 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.514+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b00c5dc0 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.514+0000 7f00977fe640 1 -- 172.21.15.103:0/1552897536 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f00a800fcc0 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.514+0000 7f00977fe640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f009c06c2b0 0x7f009c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.514+0000 7f00977fe640 1 -- 172.21.15.103:0/1552897536 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6727+0+0 (secure 0 0 0) 0x7f00a808b500 con 0x7f00b015b5c0 2024-09-19T05:41:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.514+0000 7f00aeffd640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f009c06c2b0 0x7f009c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.515+0000 7f00aeffd640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f009c06c2b0 0x7f009c06e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f00a0014430 tx=0x7f00a000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.519+0000 7f00977fe640 1 -- 172.21.15.103:0/1552897536 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f00a8059190 con 0x7f00b015b5c0 2024-09-19T05:41:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:21.687+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f00b015d040 con 0x7f00b015b5c0 2024-09-19T05:41:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.389+0000 7f00977fe640 1 -- 172.21.15.103:0/1552897536 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f00a805d490 con 0x7f00b015b5c0 2024-09-19T05:41:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-19T05:41:22.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f009c06c2b0 msgr2=0x7f009c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:22.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f009c06c2b0 0x7f009c06e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f00a0014430 tx=0x7f00a000b040 comp rx=0 tx=0).stop 2024-09-19T05:41:22.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b015b5c0 msgr2=0x7f00b0146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:22.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b015b5c0 0x7f00b0146b90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f00b00c6b90 tx=0x7f00a8007430 comp rx=0 tx=0).stop 2024-09-19T05:41:22.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 shutdown_connections 2024-09-19T05:41:22.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f009c06c2b0 0x7f009c06e770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:22.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b015b5c0 0x7f00b0146b90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:22.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b01561e0 0x7f00b0146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:22.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 --2- 172.21.15.103:0/1552897536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0098004120 0x7f00b01f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:22.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.391+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 >> 172.21.15.103:0/1552897536 conn(0x7f00b006f730 msgr2=0x7f00b0071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:22.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.392+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 shutdown_connections 2024-09-19T05:41:22.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.392+0000 7f00b564c640 1 -- 172.21.15.103:0/1552897536 wait complete. 2024-09-19T05:41:22.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T05:41:22.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.513+0000 7f41efb86640 1 Processor -- start 2024-09-19T05:41:22.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.513+0000 7f41efb86640 1 -- start start 2024-09-19T05:41:22.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41efb86640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f41e80c8160 0x7f41e806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:22.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41efb86640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e80c85d0 con 0x7f41e80c4140 2024-09-19T05:41:22.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41efb86640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e80c4760 con 0x7f41e806f510 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41efb86640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f41e815a810 con 0x7f41e80c8160 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41ee123640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f41e80c8160 0x7f41e806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41ee123640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f41e80c8160 0x7f41e806f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51310/0 (socket says 172.21.15.103:51310) 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41ee123640 1 -- 172.21.15.103:0/2344194858 learned_addr learned my addr 172.21.15.103:0/2344194858 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41ee123640 1 -- 172.21.15.103:0/2344194858 >> v1:172.21.15.174:6789/0 conn(0x7f41e806f510 legacy=0x7f41e815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41ee123640 1 -- 172.21.15.103:0/2344194858 >> v1:172.21.15.103:6789/0 conn(0x7f41e80c4140 legacy=0x7f41e815fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.514+0000 7f41ee123640 1 -- 172.21.15.103:0/2344194858 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e80c4a40 con 0x7f41e80c8160 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.515+0000 7f41ee123640 1 --2- 172.21.15.103:0/2344194858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e806f8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f41e815a990 tx=0x7f41e002c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d3d4e1d32cf383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.515+0000 7f41ec920640 1 -- 172.21.15.103:0/2344194858 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0036020 con 0x7f41e80c8160 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.515+0000 7f41ec920640 1 -- 172.21.15.103:0/2344194858 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f41e0032820 con 0x7f41e80c8160 2024-09-19T05:41:22.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.515+0000 7f41ec920640 1 -- 172.21.15.103:0/2344194858 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0032c10 con 0x7f41e80c8160 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.515+0000 7f41efb86640 1 -- 172.21.15.103:0/2344194858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 msgr2=0x7f41e806f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.515+0000 7f41efb86640 1 --2- 172.21.15.103:0/2344194858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e806f8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f41e815a990 tx=0x7f41e002c960 comp rx=0 tx=0).stop 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.516+0000 7f41efb86640 1 -- 172.21.15.103:0/2344194858 shutdown_connections 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.516+0000 7f41efb86640 1 --2- 172.21.15.103:0/2344194858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e806f8f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.516+0000 7f41efb86640 1 -- 172.21.15.103:0/2344194858 >> 172.21.15.103:0/2344194858 conn(0x7f41e806e9f0 msgr2=0x7f41e806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.516+0000 7f41efb86640 1 -- 172.21.15.103:0/2344194858 shutdown_connections 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.516+0000 7f41efb86640 1 -- 172.21.15.103:0/2344194858 wait complete. 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 Processor -- start 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 -- start start 2024-09-19T05:41:22.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e806f510 0x7f41e8152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e80c4140 0x7f41e8152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e81efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8068800 con 0x7f41e80c8160 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41e815aa60 con 0x7f41e806f510 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.517+0000 7f41efb86640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f41e815b690 con 0x7f41e80c4140 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e81efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e81efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51322/0 (socket says 172.21.15.103:51322) 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 -- 172.21.15.103:0/930715620 learned_addr learned my addr 172.21.15.103:0/930715620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ed922640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e806f510 0x7f41e8152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ed121640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e80c4140 0x7f41e8152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 -- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e80c4140 msgr2=0x7f41e8152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:22.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e80c4140 0x7f41e8152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 -- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e806f510 msgr2=0x7f41e8152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e806f510 0x7f41e8152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 -- 172.21.15.103:0/930715620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e815a1d0 con 0x7f41e80c8160 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41ee123640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e81efc30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f41e000b2c0 tx=0x7f41e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41e67fc640 1 -- 172.21.15.103:0/930715620 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0036040 con 0x7f41e80c8160 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41e67fc640 1 -- 172.21.15.103:0/930715620 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f41e00453f0 con 0x7f41e80c8160 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e815a4b0 con 0x7f41e80c8160 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41e67fc640 1 -- 172.21.15.103:0/930715620 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0045800 con 0x7f41e80c8160 2024-09-19T05:41:22.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.518+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e8159340 con 0x7f41e80c8160 2024-09-19T05:41:22.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.519+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e81572a0 con 0x7f41e80c8160 2024-09-19T05:41:22.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.520+0000 7f41e67fc640 1 -- 172.21.15.103:0/930715620 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41e0039020 con 0x7f41e80c8160 2024-09-19T05:41:22.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.520+0000 7f41e67fc640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f41d406c2b0 0x7f41d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:41:22.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.520+0000 7f41e67fc640 1 -- 172.21.15.103:0/930715620 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6197+0+0 (secure 0 0 0) 0x7f41e00aea70 con 0x7f41e80c8160 2024-09-19T05:41:22.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.520+0000 7f41ed922640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f41d406c2b0 0x7f41d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:41:22.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.520+0000 7f41ed922640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f41d406c2b0 0x7f41d406e770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f41d8007fd0 tx=0x7f41d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:41:22.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.524+0000 7f41e67fc640 1 -- 172.21.15.103:0/930715620 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f41e0040070 con 0x7f41e80c8160 2024-09-19T05:41:22.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:22.693+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f41e806c8b0 con 0x7f41e80c8160 2024-09-19T05:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.394+0000 7f41e67fc640 1 -- 172.21.15.103:0/930715620 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f41e002f070 con 0x7f41e80c8160 2024-09-19T05:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' removed 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.397+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f41d406c2b0 msgr2=0x7f41d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.397+0000 7f41efb86640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f41d406c2b0 0x7f41d406e770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f41d8007fd0 tx=0x7f41d8009040 comp rx=0 tx=0).stop 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.397+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 msgr2=0x7f41e81efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.397+0000 7f41efb86640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e81efc30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f41e000b2c0 tx=0x7f41e00046c0 comp rx=0 tx=0).stop 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 shutdown_connections 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:6832/2804194317,v1:172.21.15.103:6833/2804194317] conn(0x7f41d406c2b0 0x7f41d406e770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80c8160 0x7f41e81efc30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:23.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e80c4140 0x7f41e8152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:23.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 --2- 172.21.15.103:0/930715620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e806f510 0x7f41e8152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:41:23.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 >> 172.21.15.103:0/930715620 conn(0x7f41e806e9f0 msgr2=0x7f41e80732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:41:23.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 shutdown_connections 2024-09-19T05:41:23.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-19T05:41:23.398+0000 7f41efb86640 1 -- 172.21.15.103:0/930715620 wait complete. 2024-09-19T05:41:23.413 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T05:41:23.413 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T05:41:23.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.422 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T05:41:23.422 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T05:41:23.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.472 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T05:41:23.472 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-19T05:41:23.472 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.522 INFO:tasks.ceph.mds.e:Stopped 2024-09-19T05:41:23.522 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T05:41:23.522 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.532 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T05:41:23.532 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T05:41:23.532 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.583 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T05:41:23.583 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-19T05:41:23.583 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.634 INFO:tasks.ceph.mds.f:Stopped 2024-09-19T05:41:23.634 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T05:41:23.634 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T05:41:23.634 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.664 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T05:41:23.665 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T05:41:23.665 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.729 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T05:41:23.730 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T05:41:23.730 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.797 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T05:41:23.798 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T05:41:23.798 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.867 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T05:41:23.867 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T05:41:23.867 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.895 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T05:41:23.896 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T05:41:23.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:23.969 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T05:41:23.969 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T05:41:23.970 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:24.035 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T05:41:24.035 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T05:41:24.035 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:24.102 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T05:41:24.102 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T05:41:24.103 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T05:41:24.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:24.130 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T05:41:24.130 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T05:41:24.130 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:24.168 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T05:41:24.168 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T05:41:24.168 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T05:41:24.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:24.181 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T05:41:24.182 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T05:41:24.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:24.219 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T05:41:24.219 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T05:41:24.220 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:41:24.270 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T05:41:24.270 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T05:41:24.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | head -n 1 2024-09-19T05:41:24.313 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:41:24.313 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T05:41:24.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:41:24.665 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T05:41:24.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:41:24.755 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T05:41:24.810 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:41:24.811 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T05:41:24.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:41:24.871 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T05:41:25.055 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:41:25.055 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T05:41:25.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:41:25.169 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T05:41:25.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:41:25.225 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T05:41:25.284 INFO:tasks.ceph:Archiving mon data... 2024-09-19T05:41:25.285 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/data/mon.a.tgz 2024-09-19T05:41:25.285 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-19T05:41:25.301 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.qqS5pFFYRV 2024-09-19T05:41:25.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.qqS5pFFYRV 2024-09-19T05:41:25.439 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.qqS5pFFYRV 2024-09-19T05:41:25.523 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.qqS5pFFYRV is 320KB 2024-09-19T05:41:25.619 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.qqS5pFFYRV 2024-09-19T05:41:25.634 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/data/mon.b.tgz 2024-09-19T05:41:25.634 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-09-19T05:41:25.652 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.yLrUESSCNS 2024-09-19T05:41:25.653 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.yLrUESSCNS 2024-09-19T05:41:25.795 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.yLrUESSCNS 2024-09-19T05:41:25.879 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.yLrUESSCNS is 358KB 2024-09-19T05:41:25.973 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.yLrUESSCNS 2024-09-19T05:41:25.989 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/data/mon.c.tgz 2024-09-19T05:41:25.989 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-09-19T05:41:26.043 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.MpsqkMVZI9 2024-09-19T05:41:26.043 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MpsqkMVZI9 2024-09-19T05:41:26.174 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.MpsqkMVZI9 2024-09-19T05:41:26.257 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.MpsqkMVZI9 is 357KB 2024-09-19T05:41:26.352 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.MpsqkMVZI9 2024-09-19T05:41:26.367 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T05:41:26.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T05:41:26.370 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T05:41:26.455 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T05:41:26.486 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T05:41:26.486 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T05:41:26.488 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/remote/smithi103/crash 2024-09-19T05:41:26.489 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T05:41:26.522 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/remote/smithi174/crash 2024-09-19T05:41:26.523 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T05:41:26.550 INFO:tasks.ceph:Shutting down logrotate 2024-09-19T05:41:26.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:26.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:26.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:26.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T05:41:26.689 INFO:tasks.ceph:Compressing logs... 2024-09-19T05:41:26.689 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:41:26.708 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:41:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T05:41:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47820.log 2024-09-19T05:41:26.772 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.36531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36695.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.36695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36571.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36695.log.gz 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.36571.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36571.log.gz 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36782.log 2024-09-19T05:41:26.773 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36491.log 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.36782.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36782.log.gz 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.36491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5/var/log/ceph/ceph-mon.c.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr: --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.36742.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.6.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-19T05:41:26.774 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T05:41:26.775 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-19T05:41:26.775 INFO:teuthology.orchestra.run.smithi174.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T05:41:26.775 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T05:41:26.775 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36651.log 2024-09-19T05:41:26.775 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mon.b.log: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T05:41:26.779 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-09-19T05:41:26.779 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.36651.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36651.log.gz 2024-09-19T05:41:26.779 INFO:teuthology.orchestra.run.smithi174.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-19T05:41:26.791 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-19T05:41:26.791 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.36611.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-09-19T05:41:26.820 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.f.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.47820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48282.log 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46398.log 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47862.log 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42457.log: /var/log/ceph/ceph-client.admin.48282.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47820.log.gz 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43835.log: /var/log/ceph/ceph-client.admin.46398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48198.log 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-09-19T05:41:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47862.log: 88.0% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz -- replaced with /var/log/ceph/ceph-client.admin.48282.log.gz 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- 89.7% /var/log/ceph/ceph-client.admin.40570.log 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46398.log.gz 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47862.log.gz 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48862.log 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48198.log: /var/log/ceph/ceph-client.admin.40570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48198.log.gz 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40570.log.gz 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48862.log.gz 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-09-19T05:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44297.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47988.log 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42541.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43368.log 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46524.log 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43368.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47988.log.gz 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30373.log 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46524.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.43368.log.gz 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2024-09-19T05:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46524.log.gz 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.tmp-client.admin.30373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30373.log.gz 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47736.log 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42239.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42036.log 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42802.log 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47736.log.gz 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42036.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42802.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42036.log.gz 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42499.log 2024-09-19T05:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42802.log.gz 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40800.log 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42625.log 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40800.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42499.log.gz 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46482.log 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44549.log 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40800.log.gz 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42625.log: /var/log/ceph/ceph-client.admin.46482.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.42625.log.gz 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44942.log 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46482.log.gz 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43138.log 2024-09-19T05:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44549.log: /var/log/ceph/ceph-client.admin.44942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48324.log 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44942.log.gz 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44549.log.gz 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43138.log.gz 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46567.log 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48324.log.gz 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41125.log 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47151.log: /var/log/ceph/ceph-client.admin.46567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45812.log 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41125.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.46567.log.gz 2024-09-19T05:41:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44423.log 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44339.log 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45812.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41125.log.gz 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44423.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45812.log.gz 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44423.log.gz 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44339.log: /var/log/ceph/ceph-client.admin.45543.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44339.log.gz 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45586.log 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43853.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45586.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2024-09-19T05:41:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40714.log 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49087.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45586.log.gz 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42197.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41363.log 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.41293.log -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40714.log: /var/log/ceph/ceph-client.admin.41363.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40714.log.gz 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43837.log 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47694.log 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41293.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41363.log.gz 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42415.log 2024-09-19T05:41:26.828 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43837.log.gz 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41293.log.gz 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42373.log 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47694.log.gz 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48240.log 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42415.log: /var/log/ceph/ceph-client.admin.42373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40998.log 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42415.log.gz 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42373.log.gz 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48450.log 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2024-09-19T05:41:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40998.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48240.log.gz 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48450.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40998.log.gz 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42800.log 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48450.log.gz 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42583.log 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43836.log: /var/log/ceph/ceph-client.admin.42800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42800.log.gz 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44465.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42583.log.gz 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43702.log 2024-09-19T05:41:26.830 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41209.log 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42803.log: /var/log/ceph/ceph-client.admin.43702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41209.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43702.log.gz 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41209.log.gz 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41083.log 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43136.log: /var/log/ceph/ceph.audit.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47553.log 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44168.log 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41083.log: /var/log/ceph/ceph-client.admin.47553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48114.log 2024-09-19T05:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41083.log.gz 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47553.log.gz 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47946.log 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44168.log.gz 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48114.log: /var/log/ceph/ceph-client.admin.44210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46651.log 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48114.log.gz 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47946.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-09-19T05:41:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45978.log 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46651.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47946.log.gz 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43722.log 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46651.log.gz 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45978.log: /var/log/ceph/ceph-client.admin.43722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.45978.log.gz 87.3% 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43722.log.gz 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47904.log 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-09-19T05:41:26.833 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49045.log: /var/log/ceph/ceph-client.admin.47904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48492.log 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47904.log.gz 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47235.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42801.log 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48492.log: /var/log/ceph/ceph-mds.a.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48156.log 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48492.log.gz 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41251.log 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48594.log 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42801.log.gz 2024-09-19T05:41:26.834 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48156.log.gz 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47006.log 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41251.log.gz 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48594.log.gz 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43127.log 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41040.log 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.47006.log.gz 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41040.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42289.log 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43127.log.gz 2024-09-19T05:41:26.835 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41040.log.gz 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40756.log 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48736.log 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42289.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40756.log: gzip -5 --verbose 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42289.log.gz 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.43839.log 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40756.log.gz 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41167.log 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48736.log.gz 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43839.log.gz 2024-09-19T05:41:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36682.log 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43487.log 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44747.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41167.log.gz 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49003.log 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36682.log.gz 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43483.log 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46062.log 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49003.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43487.log.gz 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49003.log.gz 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43483.log.gz 2024-09-19T05:41:26.837 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40672.log 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46062.log: /var/log/ceph/ceph-client.admin.47277.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46062.log.gz 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47108.log 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.a.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40672.log.gz -- 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.43484.log 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43140.log 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47108.log.gz 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48408.log 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43484.log.gz 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46440.log 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43140.log.gz 2024-09-19T05:41:26.838 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43486.log 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48408.log: /var/log/ceph/ceph-client.admin.46440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48534.log 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43486.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.46440.log.gz 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48408.log.gz 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48534.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43486.log.gz 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36770.log 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48534.log.gz 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43840.log 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45670.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36770.log.gz 2024-09-19T05:41:26.839 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44038.log/var/log/ceph/ceph-client.admin.43840.log: 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43840.log.gz 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45335.log 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44122.log 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42806.log: /var/log/ceph/ceph-client.0.45335.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.45335.log.gz 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41785.log 2024-09-19T05:41:26.840 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47495.log 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44122.log.gz 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48072.log 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47495.log.gz 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48072.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48072.log.gz 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42804.log 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46165.log: /var/log/ceph/ceph-mgr.y.log: 92.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41785.log.gz 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42804.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42804.log.gz 2024-09-19T05:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40455.log 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43367.log 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40455.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44681.log 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40455.log.gz 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43367.log: /var/log/ceph/ceph-client.admin.44681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43367.log.gz 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.44681.log.gz 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr: 85.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2024-09-19T05:41:26.842 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40356.log 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43133.log 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40356.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40356.log.gz 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44507.log 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43133.log.gz 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43488.log 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44507.log.gz 2024-09-19T05:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40954.log 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43139.log: /var/log/ceph/ceph-client.admin.43488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45754.log 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40954.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43488.log.gz 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gz 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40912.log 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44381.log 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40912.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45754.log.gz 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45712.log 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40912.log.gz 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48820.log 2024-09-19T05:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44381.log: /var/log/ceph/ceph-client.admin.45712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48030.log 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48820.log: 87.7% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45712.log.gz 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44381.log.gz 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr:gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48820.log.gz 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48366.log 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46314.log 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48030.log.gz/var/log/ceph/ceph-client.admin.48366.log: 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41978.log 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48366.log.gz 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44255.log 2024-09-19T05:41:26.845 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46314.log: /var/log/ceph/ceph-client.admin.41978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44255.log: 88.4% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41978.log.gz 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46314.log.gz 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44255.log.gz 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42805.log 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48654.log 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42805.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45893.log 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42805.log.gz 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46250.log 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48654.log: /var/log/ceph/ceph-client.admin.45893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2024-09-19T05:41:26.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46250.log: 88.6% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45893.log.gz 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48654.log.gz 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46250.log.gz 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz/var/log/ceph/ceph-client.admin.47193.log: 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46356.log 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46964.log: /var/log/ceph/ceph-client.admin.45499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46356.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-09-19T05:41:26.847 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.46356.log.gz 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43142.log 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43142.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gz 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43142.log.gz 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42113.log 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45936.log: /var/log/ceph/ceph-client.admin.46787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48694.log 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42113.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-19T05:41:26.848 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42113.log.gz 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47778.log 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8%/var/log/ceph/ceph-mds.e.log: -- replaced with /var/log/ceph/ceph-client.admin.48694.log.gz 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40862.log 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47778.log: /var/log/ceph/ceph-client.admin.40862.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47778.log.gz 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40862.log.gz 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-19T05:41:26.849 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44615.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47421.log 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43143.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gz 2024-09-19T05:41:26.855 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44813.log 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44813.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47421.log.gz 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44813.log.gz 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46020.log: 89.0%/var/log/ceph/ceph-client.admin.46696.log: -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-09-19T05:41:26.856 INFO:teuthology.orchestra.run.smithi174.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T05:41:26.866 INFO:teuthology.orchestra.run.smithi174.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T05:41:26.897 INFO:teuthology.orchestra.run.smithi103.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-19T05:41:27.049 INFO:teuthology.orchestra.run.smithi103.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T05:41:27.388 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T05:41:27.395 INFO:teuthology.orchestra.run.smithi174.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T05:41:27.419 INFO:teuthology.orchestra.run.smithi174.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T05:41:27.429 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T05:41:27.441 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T05:41:27.442 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T05:41:27.482 INFO:teuthology.orchestra.run.smithi174.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T05:41:27.484 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-09-19T05:41:27.484 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m0.740s 2024-09-19T05:41:27.484 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m2.868s 2024-09-19T05:41:27.485 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.134s 2024-09-19T05:41:27.514 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T05:41:27.516 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-19T05:41:27.516 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m0.796s 2024-09-19T05:41:27.516 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m3.188s 2024-09-19T05:41:27.516 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m0.229s 2024-09-19T05:41:27.517 INFO:tasks.ceph:Archiving logs... 2024-09-19T05:41:27.517 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/remote/smithi103/log 2024-09-19T05:41:27.518 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:41:28.155 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/remote/smithi174/log 2024-09-19T05:41:28.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:41:28.610 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T05:41:28.620 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T05:41:28.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:41:28.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:41:28.704 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T05:41:28.712 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T05:41:28.713 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:41:28.715 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:41:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:41:28.730 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:41:28.733 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:41:28.733 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-19T05:41:28.733 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 -140us[ -137us] +/- 51ms 2024-09-19T05:41:28.733 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 +443us[ +445us] +/- 66ms 2024-09-19T05:41:28.733 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -346us[ -344us] +/- 89ms 2024-09-19T05:41:28.733 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:41:28.734 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:41:28.735 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-19T05:41:28.735 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 -130us[ -120us] +/- 51ms 2024-09-19T05:41:28.735 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 +444us[ +444us] +/- 66ms 2024-09-19T05:41:28.735 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -324us[ -324us] +/- 89ms 2024-09-19T05:41:28.735 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:41:28.736 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T05:41:28.795 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T05:41:28.796 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T05:41:28.878 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:41:28.945 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:41:29.009 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:41:29.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:41:29.039 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:41:29.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:41:29.067 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T05:41:29.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T05:41:29.126 INFO:teuthology.task.internal:Duration was 608.472993 seconds 2024-09-19T05:41:29.126 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T05:41:29.240 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T05:41:29.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:41:29.242 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:41:29.280 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:41:29.282 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:41:29.756 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T05:41:29.756 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-19T05:41:29.757 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:41:29.817 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-09-19T05:41:29.817 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:41:29.844 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T05:41:29.844 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:41:29.860 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:41:29.911 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T05:41:29.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:41:29.926 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:41:30.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T05:41:30.061 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T05:41:30.061 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:41:30.086 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:41:30.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T05:41:30.121 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:41:30.130 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:41:30.150 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-19T05:41:30.174 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-09-19T05:41:30.195 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:41:30.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:41:30.218 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:41:30.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:41:30.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T05:41:30.260 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T05:41:30.261 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/remote/smithi103 2024-09-19T05:41:30.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:41:30.296 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911686/remote/smithi174 2024-09-19T05:41:30.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:41:30.328 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T05:41:30.328 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:41:30.332 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:41:30.378 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T05:41:30.389 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T05:41:30.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T05:41:30.423 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T05:41:30.423 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:41:30.427 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:41:30.439 INFO:teuthology.orchestra.run.smithi103.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:41 /home/ubuntu/cephtest 2024-09-19T05:41:30.442 INFO:teuthology.orchestra.run.smithi174.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:41 /home/ubuntu/cephtest 2024-09-19T05:41:30.444 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T05:41:30.480 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T05:41:30.584 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} duration: 608.4729928970337 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T05:41:30.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:41:30.698 INFO:teuthology.run:pass